THE SU(3) CASSON INVARIANT FOR INTEGRAL HOMOLOGY 

3-SPHERES 



HANS U. BODEN AND CHRISTOPHER M. HERALD 

Abstract. We derive a gauge theoretic invariant of integral homology 3-spheres 
which counts gauge orbits of irreducible, perturbed flat SU(3) connections with 
sign given by spectral flow. To compensate for the dependence of this sum on 
perturbations, the invariant includes contributions from the reducible, perturbed 
flat orbits. Our formula for the correction term generalizes that given by Walker in 
his extension of Casson's SU(2) invariant to rational homology 3-spheres. 



1. Introduction 

Since its introduction in 1985, Casson's invariant |3|, has been the focus of intense 
study. For example, it has been shown that it extends as a Q-valued invariant of 
oriented 3-manifolds which retains most of the important properties of the original 
invariant (for details, see |25|, [14| and the references contained therein). Its relevance 
to gauge theory was recognized by C. Taubes, who related it to the Euler characteristic 



for the instanton homology groups defined by A. Floer J24], |6j. Because Casson's 
invariant is essentially defined as an algebraic count of the number of conjugacy 
classes of irreducible representations g : iriX — > SU(2), it is widely believed that 
there exists a sequence of related invariants \su(n)(X) which "count" the number of 
conjugacy classes of irreducible representations g : ttiX — ► SU(n). One program for 
realizing these invariants was proposed by S. Cappell, R. Lee, and E. Miller in the 
research announcement ||. 

The present article establishes the existence of such an invariant for the group SU (3) 
in case X is an integral homology 3-sphere. The main difficulty in defining Xsu(n)(X) 
is that one must first perturb so that the space of irreducible representations is cut 
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out transversely, but the resulting (signed) count will depend on the perturbation 
used. To obtain a well-defined invariant, one must devise a correction term involving 
only the reducible representations which compensates for this dependence. 

In extending Casson's SU(2) invariant to rational homology 3-spheres, K. Walker 
gave a formula for the correction term using the symplectic geometry and strati- 
fied structure of representation varieties associated to a Heegaard splitting of the 3- 
manifold [p5[| . Although the situation of SU(3) representations of integral homology 
3-spheres is similar to that of SU(2) representations of rational homology 3-spheres 
(because in both cases there is only one stratum of reducibles to worry about), we 
adopt a different approach and use instead gauge theory. This means that we view 
conjugacy classes of representations as gauge orbits of flat connections via holonomy 
and study the moduli space of solutions to the (perturbed) flatness equation as the 
critical set of the (perturbed) Chern-Simons functional. The appropriate interpreta- 
tion of our arguments in the SU(2) case would lead to a gauge-theoretic formula for 
Walker's invariant (cf. |]| pH). 

We now give a brief outline of the contents of this paper. The rest of this section 
presents the fundamental notions of 3-manifold SU(3) gauge theory and describes 
our main result. Section 2 introduces the perturbations and the perturbed flatness 
equation. Section 3 is devoted to establishing structure theorems for the moduli space 
of perturbed flat connections and for the parameterized moduli space. It is important 
to notice that regularity for the parameterized moduli space does not imply that it is 
smooth; it typically has non-manifold points which we call bifurcation points. These 
singularities look locally like 'T' intersections. 

Section 4 introduces the spectral flow orientation on the moduli spaces. Subsection 
4.4 deserves special mention because it contains a comparison of the orientations on 
different strata of the parameterized moduli space near a bifurcation point. This is a 
key ingredient in our main result, which is a formula for the SU(3) Casson invariant 
and the statement that it defines an invariant of integral homology 3-spheres. All of 
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this is explained in section 5 (cf. Theorem |]). The final section contains technical 
results concerning the existence of perturbations for SU(3) gauge theory. 

Both authors would like to acknowledge generous postdoctoral support from Mc- 
Master University and the Max Planck Institute. C.H. is also grateful to Swarthmore 
College for a research grant. Many thanks to Tomasz Mrowka for suggesting this 
problem and for kindly sharing his insight on the subject, and also to Andrew Nicas, 
Brian Hall and Thomas Hunter for numerous illuminating conversations. 

1.1. SU(3) gauge theory. Suppose X is a closed, oriented 3-manifold and P is a 
principal SU (3) bundle over X. For topological reasons, P is trivial. Pick a trivializa- 
tion P = X x SU(3) and denote by fl p (X; su(3)) the space of smooth p-forms with 
values in the adjoint bundle adP = X x su(3). Let A be the space of smooth connec- 
tions in P; A is an affine space modeled on Q 1 (X; su(3)). A gauge transformation is a 
bundle automorphism g : P — > P, and the group of smooth gauge transformations Q 
can be identified with C°°(X, SU(3)). This group acts on A by g ■ A = gAg~ x + gdg~ x 
with quotient 

b = A/g. 

As usual, the gauge group action is not free. Let .4* denote the subset of irreducible 
connections, i.e., those with stabilizer Z(SU(3)) = Z3, and set B* = A* /Q. While 
B is singular at gauge orbits with stabilizer different from Z 3 , if A and Q are given 
the L\ and L\ topologies, respectively, then B* inherits the structure of a pre-Banach 
manifold. For the most part, we will omit the references to the Sobolev completions 
in this paper because a detailed account of the analysis can be found in |24[ . 

Assume from now on that X is an integral homology 3-sphere unless otherwise 
specified. Then the stabilizer of any flat connection is isomorphic to SU(3), U(l), 
or Z 3 (among nonflat connections, there are two other possibilities, U(l) x U(l) 
and S(U(2) x U(l))). Let A r denote the space of all connections with stabilizer 
isomorphic to U(l); these are the nonabelian connections which reduce to S(U(2) x 
£7(1)) connections. We adopt the convenient, if not standard, terminology whereby 
A reducible means A e A r . 
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The quotient B r = A r /Q, while a singular stratum of B, is itself a smooth manifold. 
This may be seen by noticing that A G A r if and only if it is gauge equivalent 
to a connection whose 1-form takes values in s(u(2) x u(l)), and that this 1-form 
is unique up to gauge transformations g G C°°(X, S(U(2) x U(l))). Thus B r = 

A* S (U(2)xU(l)) I Ss(U(2)xU{l))- 

For A £ A, the curvature is the element F(A) G Q 2 (X; su(3)) defined by 

F(A) = dA + A A A. 

Then A G A is flat in case F(A) = 0, and the moduli space of flat connections is 

M = {A g A | F(A) = 0}/Q c B. 

Set M* = MnB* and A4 r = MnB r . A well known theorem identifies M with the 
space of representations g : 7TiX — > SU(3) modulo conjugation. 
The Chern-Simons functional CS(A) is defined by 

CS(A) = ^—( tr(A AdA + ^AAAAA). 
8vH J x 

There is an isomorphism ttqQ = Z given by ^ i — ^ degg (see Proposition |4.2| ). If g G Q, 
then C5(5> • A) = degg + CS(A), thus CS descends to a map 

CS :B — ► R/Z = 5 1 . 

Choose an orientation and a Riemannian metric on X. This provides a Hodge star 
operator * : Q P (X; su(3)) — > Q 3 ~ P (X; su(3)) and an L 2 Riemannian metric on A, 
given by (a,b) L 2 — — j x tr(a A *b). Taking the gradient of CS with respect to this 
metric, one computes that 

VCS(A) = -±- 2 *F(A), 

and hence the set of critical points of CS, modulo Q, is exactly the moduli space of 
flat connections Ai. 

The linearization of the flatness equation *F(A) = is given by the operator 
*dA '■ fi 1 (X;sw(3)) — > Q 1 (X ; su(3)) . As in |]2^| , we extend this to the self-adjoint, 
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elliptic operator 

K A : n°(X; su(3)) © SV-(X] su(3)) — ► fi°(X; su(3)) © ^(X; su(3)) 

Notice that kerii^ = 7Y^(X; su(3)) ©H^(X; su(3)), the space of o^-harmonic (0+1)- 
forms. 

For X any closed 3- manifold, the moduli space of flat 577(3) connections M. is com- 
pact and has expected dimension zero since Ka is self-adjoint. Achieving transversal- 
ity requires the use of perturbations, and we employ the same techniques here that 
were successful in the SU{2) setting [^4], ||, [UJ. 

We define a class of admissible perturbation functions in Section 2 by which to vary 
the Chern-Simons functional. The construction of an admissible function h involves 
taking a sum of invariant functions applied to the holonomy around a collection 
of loops (integrated over normal disks of tubular neighborhoods of the loops). The 
perturbed Chern-Simons functional is then CSh(A) = CS(A)+h(A), and a connection 
is called /i-perturbed flat if it is a critical point of CSh ■ We show in Section 3 that it 
is possible to choose an admissible function h such that M\ and M. r h are compact 0- 
dimensional submanifolds of B* and B r consisting of orbits that meet a cohomological 
regularity condition. 



1.2. Main result. We begin by recalling from |23[] the gauge-theoretic definition of 
Casson's invariant X(X) in case X is an integral homology 3-sphere. First, choose 
a small perturbation h so that the perturbed flat SU(2) moduli space is a compact, 
smooth, oriented 0-manifold. Then the number of irreducible, perturbed flat connec- 
tions counted with sign is seen to be independent of the choice of perturbation h. This 
follows from the classification of 1-manifolds once it is verified that for generic, one- 
parameter families of perturbations, the irreducible part of the parameterized SU (2) 
moduli space is a smooth cobordism between the two moduli spaces at either end. 
Taubes identified the resulting invariant as —2 times Casson's invariant, normalized 



as in U (see [13| for an explanation of the minus sign). 
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In the SU(3) case, for generic one-parameter families p(t) = h t of perturbations, 
the irreducible part of the parameterized moduli space W* is an oriented 1-manifold, 
but it is not generally compact. The reducible part, WT, is a compact 1-manifold, and 
the union W* U W T is compact but not smooth. The problem is illustrated in Figure 
1, where p(t) is defined for t G [—1, 1]. The solid curves depict W* and the dotted 
curves W p . Because of the noncompact ends of W*, the parameterized moduli space 
subfails to give a smooth cobordism between M.*,^ and -M*^. Thus the algebraic 
sum of perturbed flat irreducible orbits is seen to depend on the perturbation in this 
case. 




-1 1 

Figure 1. The parameterized moduli space W* U W r p projecting ver- 
tically to [—1, 1]. 

The compactification W* is obtained by adding certain reducible orbits, called 
bifurcation points, to the non-compact ends of W*. In Figure ^ the bifurcation points 
are where the dotted and solid curves meet. To make the invariant independent of h, 
one needs a correction term which changes, when the perturbation is varied, by the 
number of bifurcation points on W p , counted with sign given by their orientation as 
boundary points of W* . 
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The oriented spectral flow along W p provides a means to calculate this number, 
as we now explain. Let f) = s(u(2) x u(l)) be the Lie subalgebra of su(3) and 
t) 1 - its orthogonal complement, which can be identified with C 2 . For any reducible 
connection A, the connection 1-form can be gauge transformed to take values in f). If A 
is /i-perturbed flat, then Q 1 (X; su(3)) = fj) ©fi x (X; fj- 1 ) is the splitting of T A A 

into tangent vectors tangent to and normal to the reducible stratum. For generic paths 
p, the bifurcation points are characterized geometrically as those reducible orbits in 
W p where the kernel of the restriction of K(A, h) to the Fj^-valued forms jumps up in 
dimension. Such a jump occurs each time the deformation complex detects a tangent 
vector normal to the reducible stratum. Hence, in a neighborhood of the bifurcation 
point in Wp, there is a path of eigenvalues of K(A, h) (on fj^-valued forms) crossing 
zero transversally, and the sign of its first derivative (relative to the orientation on 
W^) coincides with the boundary orientation of the bifurcation point. Note that 
Stab A = U{1) equivariance of K(A, h) forces the eigenvalue to have multiplicity two. 

Choosing the product connection 9 as a reference point for computing all spectral 
flows, we obtain: 

Theorem 1. Suppose X is an integral homology 3-sphere. For generic small pertur- 
bations h, M* h and A4 r h are smooth, compact O-manifolds. Choose representatives A 
for each orbit [A] G M-h-, an d in case [A] £ M- r h , choose also a flat connection A close 
to A. Define \su(3)(X,h) to be equal to 

£ (-Iff^- 1 - £ (-l) s ^ A \Sf,49,A)-iCS(A)+2), 

[A]eM* h [A]€M' h 

where Sf and Sf^ refer to the spectral flow of the operator K(A, h) on su(3) and 
f) bundle-valued forms, respectively. Then for h sufficiently small, this quantity is 
independent of h and the Riemannian metric on X , and gives a well-defined invariant 
of integral homology 3-spheres. 



Remark. This theorem will follow from |3.13| and the results in section 5. 

The second sum is our formula for the correction term. Both Sfu±(6, A) and CS(A) 
depend on the choice of representative A. It is only the difference Sf^ (6, A) —4 CS(A) 
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which is well-defined on the gauge orbit [A]. The last term in the second sum does 
not affect the argument that \su(3) is well-defined; it simply adds a certain multiple 
of the SU (2) Casson invariant to get a desirable choice of normalization. 

As an invariant, Xsucs) is insensitive to the orientation on X. In general, if 
^SU(3)(X) 0, then ttiX admits a non-trivial representation into SU(2) or SU(3). 
The conjectured rationality of CS (A) would of course imply that \su(3)(X) G Q as 
well. 

There are many interesting questions raised by Theorem [|. The most intriguing 
is what sort of surgery relations (if any) does this new invariant satisfy. A related 
question:[] is Xsucs) a finite type invariant 0, ||]? By the Casson- Walker invari- 
ant equals 6 times Ai, the first Ohtsuki invariant [plj] , so one is especially interested 
in any relationship between Xsu(3) and A2, the second Ohtsuki invariant. Positive 
results would be interesting for two reasons: (i) they would render Xsu<3) computable 
by algebraic means, and (ii) they would clarify what geometric information the finite 
type invariants carry. 

There is, of course, still the problem of defining the generalized Casson SU(n) 
invariants for n > 3. A related problem is to extend Xsu(3) to rational homology 
3-spheres. In a different direction, one can attempt to define SU(3) Floer theory. We 
leave these questions to future investigations. 



We are grateful to S. Garoufalidis for pointing out the connection here. 
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2. Perturbations 

In this section, we present the functions that will be used to perturb the Chern- 
Simons functional. After defining the perturbations and characterizing the perturbed 
flat connections, we derive those properties of the first and second derivative of the 
perturbation functions which are used later to prove that the critical set of the per- 
turbed Chern-Simons functional satisfies certain transversality conditions. 

2.1. Admissible functions. This subsection introduces the admissible functions, 
which are gauge invariant functions A — ► R obtained by applying invariant functions 
577(3) — > R to the holonomy around a collection of loops in X. We first describe 
the construction for a single loop. 

Each smoothly embedded based curve £ : S* 1 — > X defines a holonomy map 

hoh : A — ► SU(3). 

We can obtain from this a gauge invariant function / : A — > R by composing with 
an invariant function r : SU(3) — > R. For analytical reasons, it is necessary to 
mollify this function by integrating against a cut-off function on the 2-disks normal 
to £ as follows. 

Let x = (xi,X2) be coordinates on D 2 , the unit 2-dimensional disk. Fix once 
and for all a radially symmetric 2-form i] on D 2 which vanishes near the boundary 
and satisfies f D2 rj = 1. A tubular neighborhood of £ is an embedded solid torus 
7 : S* 1 x D 2 — > X. For each x G D 2 , let holj(x, A) be the holonomy of A once around 
the closed curve 7(S' 1 x {x}). For any smooth invariant function r : SU(3) — ► R, 
define the gauge invariant function p(j,t) : A — ► R by 

p(-Y,T)(A)= f T(hol^(x,A))rj{x)dx. (1) 

J D 2 

Definition 2.1. Fix T = {71, . . . , 7„}, a set of embeddings of the solid torus into X. 
Then an admissible function relative to T is a function h : A — ► R defined by 

n n „ 

K A ) = y2p(7i,n) = T2 Ti(hol yi (x,A))ri(x)dx. 
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where t% : SU (3) — > R zs an invariant function of the form n = hi o ir /or a C 3 
function hi : C — > R. Given T, we denote the space of admissible functions by Tt 
and note the identification jF r = C 3 (C, R) xn given by h i— > (/ii, . . . , ft, n ). For /i G JF r , 
de/me ||/i|| C 3 = ]T™ =1 ll^llc 3 - 

There is no real loss of generality in considering only the invariant functions of the 
type used in the previous definition. One can see this by the following result, which 
we have included for motivation. 

Proposition 2.2. 

(i) tr : SU(3) — ► C descends to a one-to-one map on conjugacy classes. 

(ii) Any smooth invariant function r : SU (3) — ► R can be written as r = f o tr for 
some smooth function f : C — > R. 

Proof. The characteristic polynomial of Me SU(3) is given by 

p M (\) = A 3 - tr(M)X 2 + tr(M)X - 1. 

Since every matrix in SU(3) is diagonalizable, any two are conjugate if and only if 
their eigenvalues coincide, and (i) follows. 

Part (ii) follows from invariant theory. Consider the case of smooth invariant 
functions on U(3). Restricting to a maximal torus T 3 , these can be viewed as S3 
invariant functions on T 3 , where S3 acts by permutation of the coordinates. The 
inclusion T 3 C C 3 is an equivariant embedding, and a classical result states that the 
algebra of invariant polynomials P(C n ) 5n is generated by the elementary, symmetric 
functions o~i, . . . ,a n (see Chapter 2A, |2TS||). This, and Theorem 2 of [P5| , proves 
(ii), since the o~j are just the coefficients of the characteristic polynomial, which, for 
M E SU(3), are given by tr(M) and tr(M). □ 

2.2. Perturbed flat connections. In this subsection, we introduce the perturbed 
flatness equation and the deformation complex of the perturbed flat moduli space. 
Suppose that F = {71, . . . , 7 m } is a set of embeddings of the solid torus into X. All 
the admissible functions in this section are to be regarded as admissible relative to T. 
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Pick a Riemannian metric on X and let * : f2 p (X; su(3)) — > f2 3 su(3)) be the 
Hodge star operator. This defines an L 2 inner product on bundle-valued p-forms by 

(a,l3) L 2 = - / tr(a A *(3) 
Jx 

and induces an L 2 metric on A. For any admissible function h : A — > R, let Vh be 
the gradient of h with respect to the L 2 metric and define 

( h :A^n 1 (X;su(3)) 

by ( h (A) = *F(A) - An 2 Vh(A). Notice that ( h (A) is just -An 2 times the gradient of 
the function from AtoR given by A ^ CS(A) + h(A). 

Definition 2.3. Suppose h is an admissible function. Then A e A is called h- 
perturbed flat if it satisfies 

*F(A) -An 2 Vh(A) = 0. 

The perturbed flat moduli space is the set of gauge orbits of perturbed flat con- 
nections, i.e., 

M h = ( h \o)/g. 

Set M* h = M h n B* and M r h = M h f] B r . 

Definition 2.4. Suppose p(t), —l<t<l,isa one-parameter family of admissible 
functions. Then the parameterized moduli space is defined as the quotient 

W„ = {(A,t)e Ax [-1,1] \{ P v(A) = 0}/g c fix [-1,1], 

with slice at t e [-1, 1] given by M p ( t) x {t} = W p n (B x {t}). Set W* = W p n 
(B* x [-1, 1]) and W r p = W p n (B r x [-1, 1]) . 

Since X is an integral homology 3-sphere, any reducible flat connection can be re- 
garded as an irreducible, flat SU(2) connection. This is no longer true for perturbed 
flat reducible connections because they typically have holonomy in a subgroup con- 
jugate to S(U(2) x [/(!)) and do not reduce any further. 



n 



The linearization of (h is given by 

*d Ah = *d A - 4tt 2 Hess h(A) : Q 1 (X;su(3)) — > Q\X;su(3)). 
This motivates the final definition of this subsection. 

Definition 2.5. Suppose that h is an admissible function and that A is h-perturbed 
flat. The deformation complex is the elliptic Fredholm complex 

d A 



Q U {X; su{3)) ^ Q\X; su{3)) *^ Q\X; su{3)) Q°{X; su(3)), 



(2) 



where d* A is the L 2 -adjoint of d A . The first two cohomology groups of this complex are 
H A (X;su(3)) = kerrf^ and H Ah (X;su(3)) = ker *d Aj h/ imd A . Notice that this is a 
self-adjoint complex, and so cohomological groups of complementary dimensions are 
identified. 

Of course, if h = 0, then (g) is just the twisted de Rham complex with the second 
half rewritten using duality. We will represent H A (X; su(3)) and H Ah (X; su(3)) by 
the spaces H A (X; su(3)) and TC Ah (X; su(3)) of harmonic forms, where a 1-form a is 
harmonic if d A a = and *d A ^{a) = 0. Geometrically, the former cohomology group 
is the Lie algebra of Stab(A), while the latter is the kernel of the linearized perturbed 
flatness equation restricted to the tangent space to the slice of the gauge group action. 

Given a complex line V C C 3 , we can decompose C 3 into V and V L . This gives 
an identification, typically different from the standard one, between C 3 and C © C 2 . 
This engenders a corresponding decomposition of the Lie algebra as su{3) = f) © h -1 , 
isomorphic (as a vector space) to s(u(2) x u(l)) © C 2 . For example, for the standard 
decomposition, 



r / 



i v 



i(a + b) c + id 
—c + id i(a — b) 
-2ia 



\ 1 



> and \)~ 



J J 



r / 



i v 



o 










Z2 



\ 1 



-z 2 



> . 



/ J 



In general, f) and f) -1 are given by conjugating the above subspaces. 

If A is a connection in the bundle P = X x SU(3) and Stab A = £7(1), then the 
action of Stab A on the canonical C 3 bundle E — > X decomposes each fiber of ad P in 
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a similar manner. We shall use the notation f) and f) without indicating the actual 
dependence of the splitting of adP on the subgroup Stab A C Q\ one can always 
gauge transform A into As(u{2)xU(i)) an d then Stab A would just give the standard 
decomposition. 

For A G A r , we decompose 1-forms in a similar manner, and Q l (X;su(3)) = 
f)) © Q}(X] f)- 1 ) is a geometric splitting of the tangent space T A A into vectors 
tangent to the reducible stratum A r and vectors normal to that stratum. If A is 
/i-perturbed flat, this leads to a splitting of the co homology groups as 

H* Aih (X; «*(3)) = H* A>h (X; {,) © ft^pf; ^). 

For convenience, set n 0+1 (X; su(3)) = n°(X;su(3)) ® n 1 (X ; su(3)) . We can fold 
the deformation complex (0) up into a single operator 

K(A, h) : ft 0+1 (X; su{3)) — ► Q 0+1 {X; su{3)) 

by setting, for (f , a) G fi°(X; su(3)) © su(3)), 

a) = (d^a, ^ + 

Notice that -^(A, /i) is a self-adjoint elliptic operator (with appropriate Sobolev norms 
on the domain and range). When A is reducible, the operator K(A, h) respects the 
decomposition of Q X (X] su(3)) described above. In particular, in Sections f| and || 
we use this to split the spectral flow of K(A, h). 

2.3. The calculus of admissible functions. In this subsection, we describe the 
first and second derivatives of functions / : A — > M obtained by composing the 
holonomy around a loop with an invariant function r : SU(3) — > R as in eqn. (|J). 

For such functions, these computations can all be performed on the pullback bun- 
dles over S 1 . Hence, throughout this section, A denotes the space of connections on 
the bundle P = S 1 x SU(3). Parameterize the circle by / : [0, 1] -> S\ f(u) = e 2wiu . 
For A G A, let hol(A) G SU(3) be the holonomy once around the circle in a counter- 
clockwise direction, based at 1 = /(0). 
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The derivatives of hol(A) may be computed as follows. For A e A, parallel trans- 
lation by A defines a trivialization of the pullback bundle /*(adP), which identifies 
tangent vectors in T&A with functions a : [0, 1] — > su(3). 

Proposition 2.6. Suppose A & A and a, b 6 T^^4. JTien 

(i) ^ + to) | = /io/(A) Jq 1 o(z/)di/, 

(ii) hoi (A + ta + sb) = hoi (A) L jjj" ' (a{y)b(n) + b{y)a((j))dndv. 



Proof. We prove (ii) and leave (i) as an exercise for the reader. 

Let P(s,t;u) G SU(3) denote the parallel translation with respect to the fixed 
trivialization from to u along the interval by the connection A + sa + tb. Then 
P(s, £; m) satisfies the differential equation 

£P(s, t; u) + (sa(u) + tb(u))P(s, t; u) = 0. (3) 

Applying to @ at (s,£) = (0,0), we obtain 



J + «) L =0 + b(u) f s P(s, 0; u)| s=Q = 0. 



(0,0) , 

Integrating with respect to u and commuting mixed partials gives 



f (a(iz) |P(0, f ; i/) | t=Q + b(u) jL s P(s, 0; i/) \ g J dv. 
Jo 



(0,0) Jo 

The equations -^P(0,t;f)\ = — f£ b(fi)dfi and -§^P(s, 0; v) | s _ Q = — a(fx)dfi can 
be obtained from (^) in a similar manner, using that P(0, 0; u) is the identity. Substi- 
tuting each of these into the equation above and evaluating at u = 1 gives the desired 
result since hoi (A + sa + tb) = hol(A)P(s, t;l). □ 

This proposition allows us to compute the first and second derivatives of any func- 
tion / : A — ► R of the form / = r o hoi, where r : SU(3) — > 1 is a smooth 
invariant function. An important example is when r is either the real or imaginary 
part of tr : SU(3) — ► C. 

Corollary 2.7. The first and second derivatives of the trace of holonomy are given 
by: 
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(i) f t tr(hol(A + ta))\ t=Q = J* tr (hol(A)a(ji)) dfi, 



(ii) -£g- t tr(hol(A + sa + tb)) ^ = /„ tr{hol(A)(a(v)b(n) + b(v)a(n))}d/jdv. 



Remark. Proposition [2.6| and Corollary |2.7| remain valid for SU(n), n > 3. 

In Section 3, we shall show that for a suitable choice of T, regularity of M. h is a 
generic condition for h G Tv near zero, and similarly for regularity of W p for p G 
C 1 ([— 1, 1], jF r ). The following proposition provides useful bounds on the derivatives 
of admissible functions. 

Proposition 2.8. (i) Fix 7 : S 1 x D 2 — > X an embedding of the solid torus and 
let ti,t 2 be the real and imaginary parts of trace on SU(3). Then there exists a 
constant C\ depending on 7 such that 



\D n p( 1 ,T j )(A)(a l ,...,a n )\<C l H\\ 



i=l 



for all A G A and for j = 1, 2. 
(ii) Fix T a collection of embedded solid tori. Then there exists a constant C2 de- 
pending on T such that the inequalities hold for all h G Tv and all A £ A 

\Dh{A){ ai )\ < C 2 \\h\\ 

c 3 ■ ll a l||L?, 

\D 2 h(A)(ai,a 2 )\ < C 2 ||/i|| C 3 • ||ai|| i2 • ||a 2 ||L2, 
\D 3 h(A)(a 1 ,a 2 ,a 3 )\ < C 2 \\h\\ C 3 ■ \\ai\\ L 2 ■ \\a 2 \\ L 2 ■ \\a 3 \\ L 2, 
\\Vh(A)\\ Ll < C 2 \\h\\ c3 . 

Proof. See [G3J, Section 8a. □ 



The last proposition of this section allows one to patch together the local regularity 



arguments to give global results in subsection |37T . 



Proposition 2.9. If C C T is compact, then \J heC M-h is also compact 



Proof. See Lemma 8.3 in [24|. □ 



15 



3. Transversality 

The goal of this section is to establish various structure theorems for the perturbed 
flat moduli space M. h and for the parameterized moduli space W p for generic h G 
T and generic p G C 1 ([— 1, 1], T\ Before doing this, we must fix a collection T of 
solid tori so that the resulting space of perturbations is general enough for these 
transversality results to hold. 

The first subsection contains a formulation of the necessary conditions on T and 
a result which implies that we can always choose T to satisfy these conditions in 
a neighborhood of M. in B x jF r . In the second subsection, we proceed with the 
transversality results for M. h and W p . 

3.1. Abundance of admissible functions. For any Asi, define 

JC A = keid* A ntt 1 (X;su(3)) 

and denote by Ua : Q 1 (X '; su(3)) — > Ka the L? orthogonal projection. The slice 
through A to the gauge action is the affine subspace 

X A = {A + a | a G IC A } C A. 

A small neighborhood of A in X A , divided by the stabilizer of A, gives a local model 
for B near [A]. 

The first proposition reduces the study of the local structure of the moduli space 
to a Fredholm problem. 

Proposition 3.1. Given a perturbed flat connection, there is a neighborhood U C Xa 
of A such that A + a G U implies that (h(A + a) =0 if and only ifUA(h(A + a). 

Proof. See Lemma 12.1.2 of [|T7| and Lemmas 28 and 29 of 0. □ 

Definition 3.2. Suppose A is a reducible h-perturbed flat connection and denote by 
B.eimH\ h (X ; f)- 1 ) the set o/Stab(A) = U(l) invariant symmetric (hence Hermitian) 
bilinear forms on TC Ah (X; f)- 1 ). 
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Definition 3.3. A collection F of embedded solid tori in X is called abundant for 

(A, h), where h G Tv and A G A* U A r is h-perturbed flat, in case there exists a finite 
subset {/i, . . . , f m } C J-'y °f admissible functions such that: 

(i) If A G A*, then the map from R m to Hom(^ ?i (X; su(3)),R) given by 
(xt,... , x m ) ^ Yh=\ XiDfi(A) is surjective. 

(ii) If Ae A r , then the map from R m to Eom(n 1 Ah (X; J)),R) © Hermft^(X; f) x ) 
given by {x u . . . , x m ) h-> (Y%Li Xi D fi(A), Yn=i x 'i Hess h{ A )) is surjective. 

Because abundance is a gauge invariant concept, it makes sense to say that V is 
abundant for ([A], h). When h = 0, we say that T is abundant for A or [A]. 

If T is abundant for (A, h) and F C V, then of course T' is also abundant for (A, h). 
The next proposition is the principal result of this subsection; it shows that there 
exists a collection F which is abundant for all nontrivial perturbed flat connections 
in a neighborhood of the flat moduli space. This is a global result and its proof will 
occupy the remainder of the subsection. The statement of the proposition is divided 
into three parts, which can be viewed as the pointwise, local, and global versions of 
the same result. 

Proposition 3.4. (i) If A £ A is a nontrivial flat connection, then there exists a 
finite collection F which is abundant for A. In case A is reducible, F and the 
subset {f\, . . . , f m } from Definition can be chosen so that for some k, 

(a) {Dfi(A), . . . ,Df k (A)} spans Hom(Wi(X; f)), R) 

(b) {Hess/ fc+ i(A),... ,Hess/ m (A)} spans EennH^X; f) 1 ) 

(c) Dfj(A) = 0forj = k + l,... ,m. 

(ii) If A G A is a nontrivial flat connection and F is abundant for A and is chosen 
as in (i), then there exists an open neighborhood U xV C B x jF r o/(LA], 0) such 
that F is abundant for all ([A'}, h) G U x V with Ch(A') = 0. 
(hi) There exist a finite collection F and an open neighborhood U x V C B x jF r of 
M \ [9] such that F is abundant for all ([A], h) G U x V with (h(A) = 0. 
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Proof. Part (i) follows from Corollary ^xj\ and Proposition |6.8| , as we now explain. 
First, assume A is irreducible. Replace all loops i coming from |6.7| (ii) by tubular 
neighborhoods 7. Next, by shrinking the tubular neighborhoods, if necessary, we can 
approximate functions / : A — > C of the form f(A) = tr(holg(A)) arbitrarily closely 
by the complex- valued functions p(j, tr)(A) defined as in equation (HI). In case A is 
reducible, apply the same procedure to obtain real- valued functions ^(7, tr®)(A) from 
the real part of tr(hole(A)) for the loops in |T7| (i). This proves (i) for A irreducible 
as well as part (a) for A reducible. 

To finish off part (i) in case A is reducible, thicken the loops obtained from an appli- 
cation of Proposition |6.8| . This provides a collection of functions with Dpi^y, tr)(A) = 
whose Hessians span H.ermH\ h (X; This proves (b) and (c) and completes the 
proof of part (i). 

Part (ii) says that abundance is an open condition around flat connections in AxJ 7 ? 
and requires several estimates, contained in Lemmas |3.5| and |3.6| . Before presenting 
those arguments, we explain how (iii) follows from (i) and (ii). 

By (i) and (ii), for any nontrivial flat connection A, we have a collection T which 
is abundant for all perturbed flat orbits ([A 1 ], h) in a neighborhood U' x V C B x jF r 
of ([A], 0). Applying this for each [A] £ M. \ [6] and using compactness, we obtain a 
finite subcover U[, . . . , U[ and corresponding collections Ti, ... ,Ti. Set T = U i=1 ^i- 
Part (iii) follows by applying (ii) once again to A and the collection T to obtain 
an open neighborhood U x V C B x jF r of ([A],0) such that V is abundant for all 
([A'],h) eUxV with Ch(A') = 0. This last step is performed for each [A] £ M \ [9], 
and compactness once again allows us to extract a finite subcover U\, . . . ,Uk of Ai\[0]. 
The proof of part (iii) is completed by setting U = [J i=l Ui and V = f] i=1 V%- 

As for part (ii), it is easiest to see this in case A is irreducible. On the other 
hand, if A is reducible, then similar reasoning shows that abundance is local in B r x 
J-'r, but whether there exists an open neighborhood in B x F T is less obvious. The 
following argument treats irreducible perturbed flat connections in a neighborhood of 
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A assuming A is reducible. Before continuing with the proof, we need to introduce 
some notation. 

Since A is a fixed reducible flat connection for the rest of this proof, we write 
/C for K,a- It is useful to decompose elements a G /C as a = (ai,a 2 ) according to 
su(3) = f) © f) ± . Thus ai G ^(X; h) and a 2 G f^(X; ^). For i = 1,2, we have the 
Hodge decomposition = (a[, a") where a[ G H\(X; fj) and a 2 G H l A (X\ h" 1 ) are the 
cohomological components and a'/, a 2 are characterized as follows. Define K![ to be the 
orthogonal complement of H\(X; h) in K,C\Q 1 (X; h), and also /C 2 to be the orthogonal 
complement of H\(X; h^) in K n fi^X; f) x ). Denote by U'{ : fi x (X; s«(3)) — ► K'( 
the L 2 orthogonal projection for % — 1,2. Then a" = Il-'a G /C-' and a = (ai,a 2 ) = 
K, a'/, a' 2 , a 2 '). We set K" = K'{ ® K% and n" = {W(, II"). 

Suppose a, b G Q 1 (X; su(3)). The notation [a Ab] indicates the product obtained by 
combining the wedge product on the form part with the Lie bracket on the coefficients. 
The following is the su(3) analog of the well-known formulas for the Lie bracket in 
su(2) (with regard to the decomposition su(2) = u(l) © ■u(l)" 1 "). If we decompose 
a = (ai, a 2 ) and b = (b±, b 2 ) according to su(3) = h © f) -1 as above, then 

*[aj A bj] G Q 1 (X; f)) if i=j, 
♦ [oiAftjlen 1 ^;^) if^j. 

The proof proceeds with two lemmas. The first one shows that the space of per- 
turbed flat irreducible connections in Xa for small h are close to the image of the 
affine subspace A + KJ[ + H\(X; su(3)). It also gives some control over the distance 
from the nearby reducibles to the affine subspace A + l-t\{X\ su(3)) in terms of the 
size of the perturbation. 

Lemma 3.5. For any I and any < R < 1, there exist K < oo and < e < 1 such 
that if A + a G Xa is h-perturbed flat with \\a\\ L 2 < e and \\h\\ C 3 < e, then 

(i) IK1U? < R \W2WLl and 

(ii) |K'|| L 2 < R (|K|| L? + ||a' 2 || £; ) + K \\h\\ c z. 
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Proof. Fix < R < 1. Consider the map from Xa x JF to /C" given by U"(h{A + a). 
The linearization at (A, 0) restricted to JC" with the L 2 norm on the domain and L 2 
norm on the range is *d A , an elliptic Fredholm operator with trivial kernel. Therefore 
there exists A > such that || * d A b"\\ L 2 > \\\b"\\ L 2 for all b" E K," . 

Now assume that Yi. A C,h{A-\- a) = 0. Expanding the equation H 2 ' (h(A + a) = gives 

= *d A (a 2 ) + 2n A * [ai A a 2 ) - Atc 2 W 2 ' Vh{A + a). 

By Taylor's theorem, the last term on the right can be replaced by 

-4vr 2 [IT,' (Hess h{A + a x ){a 2 ) + D 2 Vh(A + 01 + t 1 a 2 ){a 2 , a 2 ))] , 

for some < t\ < 1. Here we are exploiting the equivariance of (h with respect to 
the Stab(A) action. Rearranging and using the triangle inequality on a 2 = a' 2 + a^, 
we obtain 

A||4'|U ? < (2C||oi|| i? + 87r 2 C 2 ||/i|| C 3) (\\a' 2 \\ Ll + K|| L? ) , 

where C comes from the Sobolev multiplication theorems and C 2 is the constant given 
in Proposition |2l| By shrinking e to control some of the L\ norms on the right side, 
we obtain the first claim. 

To prove the second claim, expand the equation = Yl'{ Ch{A + a) to get 

= *d A (a'{) + U A * ([ai A 01] + [a 2 A a 2 ]) — 4n 2 U'l Vh(A + a). 

Rearranging, we see that 

\\\a'{\\ Ll < C (\\a4l2 + II^H 2 ,) +A<K 2 C 2 \\h\\ c z. 

Now apply the triangle inequality on the right to a\ = a[ + a" and use the first part 
to obtain the required bound. □ 

The next lemma is a similar result about tangent vectors at perturbed flat con- 
nections which are in the kernel of the Hessian of CS +h (restricted to Xa)- We 
decompose b G T A + a ^A into b = {b\, b 2 ) = (b[, b'{, b' 2 , b 2 ) as before. 
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Lemma 3.6. For any T and any < R < 1, there exist K < oo and < e < 1 such 
that if A + a G Xa is a nonabelian h-perturbed flat with \\a\\ L 2 < e and ||/i||c 3 < e > 
and if b G Ta+uXa is in the kernel of Hess( C5 1 +h)(A + a), then 
(i) \\b'(\\ L 2 < R\\b[\\ L 2+K\\a' 2 \\ L 2 ■ \\b' 2 \\ L 2 
(ii) <R\\b> 2 \\ Lf + K\\a' 2 \\ LV 

Proof. Setting the f) and f) 1 - components of D H^^A + a)(b) equal to zero gives two 
coupled equations in b\ and b 2 - Expanding the f) component leads to 

-*d A b'{ = Ha * Oi A b{\ + [a 2 A b 2 \) - 4vr 2 rU Hess /i(A + ai)(&i) 
^v^n'/Z^Hess + a x + t 2 a 2 )(&)}(a 2 ). 

Taking the L 2 norm of each side of this equation and using the various bounds as in 
the last lemma, it follows that 

MWIWl* < C (||ai|| i? ■ \\b x \\ Ll + \\a 2 \\ Ll ■ \\b 2 \\ L ^+K \\h\\c* + ||o 2 |U ? • ||6|U ? ) . 

Applying the triangle inequality, first to b = b± + b 2 and then to b\ = b^ + b" everywhere 
on the right hand side of this equation and moving all occurrences of b" to the left, 
we see that, for e small enough, 

dl^i'lli? < 2C ( e Willq + Klli? • INIi?) +Ke + 2 ll a 2lU? • + Ml?) 

< e constHfo^ || L 2 + const||a 2 || L 2 ■ ||6 2 || L 2. (4) 

Similar reasoning applied to the f)^ component of DUA(h(A + a)(b) gives 

— ||^2 Hi? < e const || £»2 II + const || 0,2 II z,^ - ||6i||l2. (5) 

The conclusion of the lemma follows from equations (f|) and (||). □ 

We are now ready to complete the proof of Proposition |3.4| (ii). Referring to part 
(i), since A is reducible, we have finite subsets {/1, . . . , ft-} and {gi, ... ,gi} of 
such that 

(i) span^/^p^) I i = 1, . . . , k} = Hom(7^(X; f)), R), 

(ii) span{D 2 ^| w i (x .|,± ) ®2 | j = 1, . . . ,/} = Herm^(X; f) x ). 
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(iii) D 9j\n\{x^) = for j = 1, . . . ,1. 

Our strategy here is to show that, given a and h sufficiently small with A + a an 
irreducible /i-perturbed flat connection, the functions {fi,gj} detect all elements b G 
ker K (A + a, h) to first order. 

Choose a constant N > such that, for all u G TC\(X; f}) and all v, w G H^X; f)- 1 ), 
the following bounds hold: 

max{|^(A)( W )|} > N\\u\\ Ll (6) 

max{|D 2 ft -(A)(i;,«;)|} > N \\v\\ l2 ■ \\w\\ L 2 (7) 
\<j<i 

Choose e small enough that these inequalities continue to hold when N is replaced 
by y and A is replaced by A + a for 1 1 a 1 1 < e- 

Suppose that h G .F r and that A + a G is an irreducible h-perturbed flat connec- 
tion, and assume b G f2 x (X; stt(3)) is an element in the kernel of Hess(CS +h)(A + a). 
Choose functions / and g from {fi} and {gj}, respectively, for which |D/(y4+a)(6 / 1 )| > 
N/2 \\b[\\ L 2 and \D 2 g(A + a)(a' 2 ,6 2 )| > N/2 \\a' 2 \\ L 2 ■ \\V 2 \\ L 2. If either Df(A + a) (6) 
and Dg(A + a) (b) is non-zero, then we are done. So we assume both vanish and seek 
a contradiction. 

Apply the triangle inequality to the equation Df(A + a)(b' 1 ) = —Df(A + a)(b" + b2) 
to get the inequality 

j\\b[\\ L2i < iDfiA + aWDl + lDfiA + a^l + lD'fiA + aJiaMl 
+ \D 3 f(A + ai +tia 2 )(a 2 , 02,62)1, 

where < t\ < 1. Then Df(A + ax)(6 2 ) is zero by invariance under Stab(A + = 
£7(1), and applying bounds to the other terms gives 
iV 

-jWb'M < C 2 H/llo. ■ |K|U f + 4C 2 ll/llo, ■ ||a 2 || L? ■ ||6 2 || i? 

Using Lemma j3~6[ , and choosing e suitably small, this implies 

N 

— < const ||a' 2 || L 2 • ||6 2 || L 2- (8) 
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Next consider Dg(A + a) (b). We first bound the derivative in the 61 direction. 
|^(A + a)(6 x )| = \Dg(A)(b 1 ) + D 2 g(A + t 1 a)(a 1 ,b 1 ) + D 2 g(A + t 2 a)(a 2 ,b 1 )\ 

= \D 2 g{A + t l a){a l M) + D 2 g{A + t 2 a 1 ){a 2 ,b l ) + D z g{A 1 ){t 2 a 2 ,a 2 M)\ 

< C 2 \\g\\ca ■ \\h\\ L l (\\a>i\\ti* + ||a2|lia) < eCsllfeillia 

< e const ||6i||x,2 + econst ||a 2 IU 2 ' II^IU 2 - (9) 

In the first line, Dg(A)(bi) = by hypothesis, and in the second, D 2 g(A+t 2 a\)(a 2 , bi) 
vanishes by gauge symmetry. The last step follows from part (i) of Lemma |3.6| . 
Finally, we bound the derivative of g in the b 2 direction away from zero. 

\Dg(A + a)(h)\ = \Dg(A + ajfa) + D 2 g(A + 0l )(a 2 , b 2 ) + D 3 g(A 2 )(a 2 , a 2 , b 2 )\ 

Appling gauge symmetry once more shows that Dg(A + ai)(b 2 ) = in the equation 
above. Bounds on the other terms give, for e sufficiently small, 

iV 

\Dg(A + a)(b 2 )\ > y||a 2 || L 2 ■ \\b 2 \\ L 2 - const ||a 2 || L 2 ■ \\b 2 \\ L 2 

- const || t^'llis • ||& 2 ||i,2 - const 1 1 411^ • \\b' 2 \\ L 2 
N, 
3" 



> ^KIIl? ■ H&2IU? - const||a 2 || 2 2 • ||&i|| L 2 (10) 



Combining inequalities (|) and ([3~0|) , we get 

N 

-jlKIU 2 • II&2IL? < econst||6i|| L 2, 

which, combined with inequality (§), gives the desired contradiction. □ 

Since X is an integral homology 3-sphere, there are no noncentral abelian flat 
connections. The following proposition guarantees that this, together with the prop- 
erty that T is abundant, continue to hold for small perturbations. It also provides a 
unique component of the flat moduli space near each perturbed flat connection, for 
small perturbations. 



Proposition 3.7. Suppose T satisfies condition (Hi) of Proposition \3^4. There exists 
an €q > such that: 



•2:', 



(i) If A E A* U A r is flat and A' G A is abelian, then \\A - A'\\q > 2e . 

(ii) If \\h\\c3 < €q and A G A is h-perturbed flat, then there exists A G A which is 
flat with \\A — A\\ L 2 < e . 

(iii) If \\h\\(p < eo and A G A is h-perturbed flat, then T is abundant for ([A], h). 

(iv) If A, A' G A r are flat and lie on different components of the space of flat con- 
nections in A, then \\A — A'\\ L 2 > 2e . 

Proof. For claims (i) and (ii), see Lemma 1.3 and Proposition 1.5 of ||24j| . Claim (iii) 



follows from claim (ii). For the neighborhoods U and V in Proposition O , choose eo 
small enough that the ball of radius eo around G Tv is contained in V and the eo 
neighborhood of Ai* U Ai r in B is contained in U. 

For part (iv), suppose to the contrary that there were no eo satisfying the conclusion. 
Then we have two sequences Ai and A\ of flat connections in A with \\Ai — ^|| L 2 < \ 
such that Ai and A\ never lie on the same component of the space of flat connections. 
By compactness of Ai, after passing to a subsequence, we can assume that there is a 
sequence of gauge transformations gi such that gi ■ Ai converges to a flat connection 
A . Then ■ A' { must also converge to A . (Note that we are using the standard 
gauge invariant L\ norm here.) 

Consequently, for i large, we see that g^ ■ Ai and gi ■ A\ must lie on the same 
component of the space of flat connections as the one containing Aq. But this implies 
that Ai and A\ lie on the same component, which is a contradiction. □ 

3.2. Regularity theorems. We are now ready to prove the structure theorems for 
Aih and W p . We begin with the definition of regularity in this context. Throughout 



this subsection, V denotes a fixed collection of solid tori satisfying Proposition p^4 , 
part (iii). Thus, V is abundant for all pairs ([A],h) E B x Tv in a neighborhood of 
(Ai \ [9]) x {0}. Choose e as in Proposition [3/?] and define ^(e ) to be the ball of 
radius eo about in the space jF r of admissible functions. 

Definition 3.8. Suppose h G ^"(eo) and U C Aih is open. Then U is regular in 

case 7i\ h (X; su(3)) is trivial for all [A] G U . 
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Regularity as defined here makes no assumption on the irreducibility of A. 

Proposition 3.9. IfU C M.h is regular, then M* h r\U and M. r h C\U are 0- dimensional 
submanifolds of B* and B r , respectively. 

Proof. This follows directly from standard Kuranishi arguments. □ 

We define regularity for the parameterized moduli space next. For any triple 
(A,p,t) E Ax C 1 ([-l,l],J r (e )) x [-1,1], define an index one Fredholm operator 
by the formula 

L(A,p,t) : fi 0+1 (X; su(3)) © R — > fi 0+1 (X; su(3)) 
(£, a, r) i- K{A, p t ) (£, a) - 4tc 2 t j^Vp t (A) 

Since X is an integral homology 3-sphere, the only abelian orbit in the flat moduli 
space is [9] , and this continues to be true for small perturbations thanks to Proposition 



3T7| . This explains why we dismiss the case of abelian orbits in the following definition. 
Note, however, that such orbits may indeed occur for large perturbations, or even for 
small perturbations on arbitrary 3-manifolds. 

Definition 3.10. Let p : [—1, 1] — > J 7 (to) be a C l curve with M. p i±i) regular. An 
open subset U C W p is regular if: 

(i) Hl >pt {X;su{3)) is trivial for ([6},t) E U. 

(ii) U contains no noncentral abelian orbits. 

(iii) For all ([A],t) e W* n U, L(A,p,t) is surjective. 

(iv) For all ([A],t) G W r p R U, fi 0+1 (X; rj) fl coker L(A, p, t) = H° A (X; su(3)) = u(l). 

(v) There is a finite subset J of Wp fl U such that for ([A], t) G WT, 



timH\ M (X;t) 



2 if {[Alt) e J 

otherwise. 



Elements of J are called bifurcation points. 

(vi) If (LA s ],t s ) is a parameterized curve in W T p fl U and (L4o],to) G J, f/ien i/ie 
(multiplicity two) eigenvalue of K(A S , p(t s )) crosses zero transversally at s = 0. 
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Note that regularity of W p does not ensure that W p is a smooth cobordism (cf. 
Lemma |3.1ip . Conditions (v) and (vi) of Definition |3.10| make sense in light of claim 



(i) of the next lemma. 

Lemma 3.11. IfU r C W r p is open and fi 0+1 (X; f)) fl coker L(A, p, t) = H° A (X; su(3)) 
for all ([A],t) G U r , then U r is a smooth 1 -manifold. 
If U C W p is open and regular, then 

(i) W* H Z7 and fl U are both smooth 1-manifolds without boundary. 

(ii) Each bifurcation point in U is the limit of exactly one noncompact endpoint of 

w;, i.e.,j=(W*\w;)nu. 

Proof. The first statement and (i) follow from condition (iv) of Definition p.lQ using 
standard Kuranishi arguments. The proof of (ii) is given below. 

Fix a bifurcation point, which we assume, for simplicity of notation, to be of the 
form ([A], 0). For some neighborhood U G B x [—1,1], W p D U is the quotient by the 
gauge group of the zero set of the map 

Q : X A x [-1, 1] — ► fi x (X; su(3)) 

given by Q(A + a,t) = n A C P (t)(A + a). 

The linearization of Q at (A, 0) is an elliptic Fredholm operator with index one 

DQ {Afi ) ■ ^(X; su(3)) © M — > JC A 

and DQ(a,q) (o, t) = H A L(A, p, 0)(0, a, r). Fix a nontrivial i> G fi 1 (X;P|) © R in the 
kernel of DQ^ A ,o)- Then kerDQ(A,o) — span{t> } © T{} A (X; f) -1 ) and coker DQ( A ,o) = 

We summarize the Kuranishi model in this situation. There is a function 

(p : ker DQ {Afi) — ► (ker DQ^)^ 

and a neighborhood U C ker DQ( A ) of zero such that Q restricted to the graph of <p\ v 
takes values in coker DQ( A ,o)- Let <f>\ and fa be the f2 1 (X; su(3)) and R components 
of and define the map ip '■ kerD<5(A,o) — >■ by setting ijj{a,r) = a + 0i(a,r). 
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Now for s£l, define ^ s : U\ po (X; f)- 1 ) — > X A by setting $? s (x) = A + tp(sv + x). 
Set CS S (A) = CS(A) + p(t a )(A), where t s = fc(sv). Observe that t = 0. Then for 
all s, 

Qoy s = -4ir 2 V(CS s oV s ), 

a family of gradient vector fields of U(l) invariant functions on 7i\ (X; t) ) = C. 

For small s, the path of orbits ([\l/ s (0)], t s ) parameterizes W r p near ([A],0). At the 
origin in TC\ (X; f) -1 ), the Hessian of CS S oty s is A s Id, where A s is the eigenvalue 



referred to in condition (vi) of Definition |3.10| . The proof now reduces to the parame- 



terized Morse Lemma. See the proof of Theorem 12 in JTTJ for a similar argument. □ 

Our proof of regularity will involve considering the irreducible and reducible uni- 
versal zero sets 

Z* = {([A],h)eB*xf(e )\C h (A) = 0} 

and 

Z r = {([A],h)eB r xF(e )\Ch(A)=0}. 

Within Z r lies a subset which we hope to avoid when choosing perturbations, namely, 
the union over all positive integers k of 

Z r k = {([A],h) G Z r | dim c ker (jT(4Zi)| nW) ) = k) . 

Proposition 3.12. The sets Z* and Z r are submanifolds of B* x J 7 (to) and B r x 
J-(eo), respectively. For each k, Z r k is a submanifold of Z r . 

Proof. Fix (L4 ],/i ) G Z*. Consider the map P : Xa x ^(e ) — > JCa given by 
P(A, h) = U-A Ch(A). The first partial derivative ^(Aq, ho) is Fredholm with cokernel 
H.\ o ho (X; sw(3)), but, since T is abundant for ([A ], h ), the image of ^£(v4 , ho) is a 
subspace which orthogonally projects onto this cokernel. Therefore P is a submersion 
at (AQ,h ). The implicit function theorem now proves that the preimage P _1 (0) C 
Xa x ^"(eo) is smooth near (Aq, ho), and hence Z* is smooth near ([Aq], ho). 

To show smoothness of Z r , apply the same argument to the map P r : X A() x 
F{eo) — > JCa H fi 1 (X; f)), which is the restriction of the map P to the reducible slice 
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X r Ao = {A + a | a G K, Ao nn^X; fj)}. That P r takes values in /C Ao nn\X; h) follows 
from Stab A equivariance. 

Next we treat the third case. Suppose that ([A ], h ) G Define 

A = min{|A| ^ | A G Spec(K Ao )}. 

Choose a neighborhood UxV C X Aq x JF(e ) of ([A)], /i ) sucn that for (A, /i) G U x V, 
the operator K(A,h) has no eigenvalue A with ^ < ]A| < 2|a. Form the small 
eigenspace bundle, which is the complex vector bundle E over UxV with fiber -E(A,h) 
equal to 

span |« G fi 0+1 (X; f) X ) | = Am where |A| < y | . 

Let HermE be the associated fiber bundle of symmetric, Stab(A ) invariant (hence 
Hermitian) bilinear forms on E, and for each k = 1,... , dime H\ h (X; f)- 1 ), let 
Herm^ E be the subbundle consisting of those bilinear forms with complex rank less 
than or equal to dime H\ h(X; f)- 1 ) — k. Notice that Herm k E has codimension k 2 in 
Herm E. 

Define K(A, h) : E(a,K) — ► E(A,h) to be the restriction of K(A, h) to E(a,h) com- 
posed with the orthogonal projection to E^,h)i an d use this to construct the section 

R : U x V — ► Herm E © (K M n Sl\X\ h)) 

given by R(A,h) = (~K(A,h), P r (A,h)) . Then Z r k = R' 1 (Herm fc E © 0) . Now we 
claim that R is a submersion at (A ,h ). Since the linearization of R in the first 
variable has cokernel T Herm£ , ( j4oiho ) © 7Y^ (^; f)), it suffices to show that the lin- 
earization in the other variable, composed with projection to this cokernel, is onto. 
This is the map T F(e ) — ► Herm (A"; f) x ) © H\ (X; h) given by 

5h^ (-4tt 2 Hess 5 h(A ), U[ V5h(A )) , 

where n' : is the projection onto H^^X; f)). But surjectivity of this map follows since 
T is abundant for ([Aq], ho). □ 
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We are finally ready to prove the regularity theorem for the moduli space and 
the parameterized moduli space. For h-i,hi G J-(eo), let C 1 ([—l,l\,J-(eo);h-i,hi) 
denote the set of C 1 curves p : [—1,1] — ► ^F(^o) with p(±l) = h±. 

Theorem 3.13. There exists a Baire setJ-ieq) C J 7 (to) such that h G J 7 (to)' implies 
Ai* h UA4 r h is regular. For any h-i, hi G JF(e ) , the set of p G C 1 ([— 1, 1], jF(eo); h-%, hi) 
for which W p is regular is Baire. 

Proof. The projections from Z*, Z r , and Z r k to ^"(eo) are Fredholm of index 0, 0, 
and — k 2 , respectively. The first two index calculations simply follow from the self- 
adjointness of the partial derivatives in the connection variable of the maps P and 
P r . The third follows easily from the second. The rest of the argument is a standard 
application of the Sard-Smale theorem and transversality (see ||, Section 4.3.2). □ 
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4. Orientations and Spectral Flow 

In this section, we introduce orientations on the parameterized moduli space and 
relate them to the spectral flow of the family of operators K(A, h) from the previous 
section. We use the index bundle of the family L to orient W* and W r p . 

The basic idea is a familiar one, used not only in 3-dimensional gauge theory by 



Taubes (see p4|), but also in 4- manifold gauge theory In fact, if W p were generically 



a cobordism, then Taubes' approach to defining an invariant would work equally well 



for SU(3). But W p is not generically a cobordism, as explained in Lemma |3.11| , and 



a relationship between the orientations on W* and W£ near a bifurcation point is 



provided by Theorem 4.7 



4.1. Orientations. Suppose that .F(eo) is fixed as in the previous section and con- 
sider the family of index one Fredholm operators 

L:Ax C\[-l,l},^{^)) x [-1,1] — > Fred 1 (fi 0+1 (X;su(3)) ®R,Q 0+1 {X;su{3))) 



introduced in subsection |3.2| . The dimension of the kernel of L(A, p,t) is not contin- 
uous in (A, p, t), so ker L does not form a vector bundle over A x C 1 ([— 1, 1], jF(eo)) x 
[—1,1]. Instead, we consider the index bundle of L, which is the element in the K- 
theory of A x C 1 ([— 1, 1], .F(eo)) x [—1,1] defined by indL = [kerL] — [cokerL], a 
virtual bundle of dimension one. 

Given vector spaces E and F of dimensions n and m, an orientation on [E] — [F] 
is an orientation on the real line 

det([E] — [F])= A n E <g> (A m F)* . 

For example, if {e±, . . . , e n } and {fi, . . . , f m } are bases for E and F, then the element 
(ei A • • • A e n ) (g) (/i A • ■ • A f m )* specifies an orientation for [E] — [F] . More generally, if 
E and F are vector bundles, then an orientation on the element [E] — [F] of .fT-theory 
is an orientation of the line bundle A n E <g> (A m F)* . 

Clearly, ind L is orientable since the parameter space is contractable. The virtual 
fiber at (9, 0, 0) is [Hg(X; su(3))©M] — [Hq(X; su(3))), and our convention for orienting 
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indL is to propagate the canonical orientation at (9, 0, 0) given by 

(v 1 A---Av 8 Aw)®(v 1 A---Av 8 )*, (11) 

where {i>i, . . . , vg} is a basis for su(3) = H? e (X; su(3)) and w is a tangent vector to 
[— 1, 1] at t — pointing in the positive direction. 

Suppose that p G C 1 ([— 1, 1], F{eo)) an d is regular. Then W* inherits an 
orientation because of the natural identification T^ A ^W* = ker L(A, p, t). There is 
also an induced orientation for WT, but this is less obvious. First, suppose G 
Wp is not a bifurcation point. An orientation is given by declaring that a nontrivial 
vector v G Tq^j^WI" is positively oriented if the element (uAv)<g>u* G det ind L(A, p, t) 
agrees with the orientation of indL for any u G u(l) = H.° A (X; su(3)). 

Now suppose that G Wp is a bifurcation point. The dimension of ker L and 

cokerL both jump by two at (A,p,t), but we obtain an orientation consistent with 
the one above by requiring that (u A x A y A v ) <g) (u A x A y)* agree with the given 
orientation on md L(A, p,t), where {x,y} is a basis for TC Ah (X; f)^), the new part of 
the kernel (and cokernel) of L at (A,p,t). 

4.2. Spectral flow. In analogy with Taubes' gauge theoretic description of the Cas- 
son invariant, our formula will involve counting irreducible perturbed flat orbits with 
sign according to their spectral flow. We adopt the following convention for computing 
the spectral flow. 

Definition 4.1. Suppose U is a real, infinite dimensional, separable Hilbert space 
and K : [0, 1] — ► SAFred(W) is a continuously differentiable family of self-adjoint 
Fredholm operators with discrete spectrum onU. Note that the eigenvalues of K t vary 
continuously differentiably. Choose 5 such that 

< 5 < inf{|A| ^ | A G Spec K U Spec K^. 

The spectral flow along K t from K to K 1 , denoted Sf(K ,Ki), is the intersection 
number, in [0, l]xR, of the graphs of the eigenvalues of K t , counted with multiplicities, 
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with the line segment from (0, —5) to (1,6). It is a homotopy invariant of the path 
K t relative to its endpoints. 



Note that with this convention for counting zero modes, 

Sf(K , K x ) + Sf(K x , K 2 ) = Sf(K , K 2 ) - dimker K x . 

We are primarily interested in the spectral flow of the operator K(A, h) from subsec- 
tion |2.2| . Completing Q 0+1 (X; su(3)) in the L 2 norm, we regard K(A, h) as a family 
of self-adjoint Fredholm operators on Q 0+1 (X; su(3)) with dense domain the space of 
L\ forms, 

K : A x r(e ) — > SAFred (Q 0+1 {X; su(3))) . 

Define deg : Q — > Z by setting degg = degg', where g' : X — ► SU(2) is a map 
homotopic to g. That deg g is well-defined follows from the next proposition, which 
can be proved by noting that SU(n) is homotopy equivalent to a CW-complex with 
3-skeleton S 3 and the next lowest cell in dimension 5. 

Proposition 4.2. Fixn > 2 and consider the standard inclusion i : SU(2) C SU(n). 

(i) Ifge C°°(X, SU(n)), then there exists g' : X — > 377(2) with i o g' ~ g. 

(ii) Ifg ,gi G C°°(X,SU(2)) with iog ~iog x , then g ~ g x . 



Proposition |4.2| gives the following formula for the spectral flow between two gauge 



equivalent connections. 

Proposition 4.3. (i) The spectral flow of K(A, h) along a path (A t , h t ) is indepen- 
dent of the path connecting (A ,h ) to (A x ,h x ). 
(ii) The spectral flow of K from (A, h) to (gA, h) equals 12 deg g — dimkerTT^, h). 

Proof. Part (i) follows since A x J-(eq) is contractable. Part (ii) follows by an index 
computation, the point being that spectral flow around a closed path in A equals the 
index of the self-duality operator on SU(3) connections over X x S 1 . Details can be 



found in [131. □ 
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Remark. Suppose A G A r . By applying a gauge transformation, we can assume 
that A G As(u(2)xU(i))- Consider now the standard decomposition of the Lie algebra 
sw(3) = \) © f)- 1 given by the action of Stab A = U{1) and split the operator K(A, h) 
accordingly Because 9 and A can be connected by a path in As(u(2)xU(i)) > the spectral 
flow of K from (9, 0) to (A, h) splits as 

Sf{9,A) = Sf h (9,A) + Sf^9,A). 

Notice that U(l) equivariance of K(A, h) implies that Sf^.±(9, A) is divisible by two. 
Using part (ii) of the previous proposition and the well-known, analogous result (for 
su(2)) that Sfu(A,gA) = 8degg — dimker -fCilfjo+ip^s,), we see that 

Sf^(AgA) = 4deg# - dimker K A \ Q o+i {x .^y 

4.3. The relationship between orientations and spectral flow. There is a fun- 
damental relationship between the orientation of the one dimensional virtual bundle 
indL and the spectral flow of K(A, h). We describe it next, in some generality. 

Suppose that U is an infinite dimensional, separable Hilbert space and that Z is a 
connected, simply connected parameter space. Let 

K : Z — ► SAFred(W) 

be a parameterized family of self-adjoint Fredholm operators on U and v : Z — > IA 
be a continuous map. 

Define L z : U © R — ► U by L z (u, r) = K z (u) + tv z for (u, r) G U © R. Clearly 
L z G Fred^WffiR,^). For any z G Z, let Il z : ker L z — > R be the projection onto R 
and rik cr i z : U © R — ► ker L z be the projection onto the ker L z . 

Suppose that zq a Z is a, fixed base point and v zo = 0. Choose an orientation O for 
indL by the convention in equation fllTl) , and let O z denote the induced orientation 
on indL z . If L z is surjective, then O z gives an orientation of kerL 2 . Notice that 
whenever K z is an isomorphism, kerL z is spanned by (— K~ x {v z \ 1). In this case, 
and more generally when v z _L keri^ 2 , the spectral flow of K z allows us to compare 
O z with another natural orientation on kerL z . 



33 



Proposition 4.4. Suppose v Zl _L ker K Zl . Then if {m, . . . , Uk} is a basis for ker K Zl , 
{u\, . . . , Uk, (— K~^(v Zl ), 1)} a basis for ker L Zl . Furthermore, the orientation on 
indL 2l agrees with 

(_l)Sf{K za ,K zl) ( Wl A . . . A Ufc A (-K-\v zl ), 1)) ® K A ... A u fe )*. 

Remark. K Z1 is an isomorphism if and only if U z is an isomorphism, and then the 
proposition states that the orientation on kerL 2l is (— l) s ^ Kz o> K n)Tl* O-r. 

Proof. The first claim is obvious. The proof of the second goes as follows. Connect 
zq to z\ by a path z t . By [Q, is homotopic relative its endpoints to a path .fQ in 



SAFred(W) so that there is a finite set {ti, . . . , 4} C (0, 1) such that 

dim ker .Kt = 



1 if * e Oi,... ,t k } 
otherwise. 



We can further assume that any eigenvalue of K t which crosses zero does so trans- 
versely. 

Similarly, v Zt can be homotoped relative to its endpoints to a path v t in U such 
that the path L t in Fred 1 ^ © WL,U) defined by L t (u,r) = K t (u) + rv t is surjective 
for all t G (0, 1]. Let Ot be the orientation on kerL t coming from Oq = O zo . 

Fix a tj with ker K tj nontrivial. For t G (tj — 5, tj + 5), let At be the eigenvalue of 
K t which crosses zero when t — tj. Choose u t to be a unit eigenvector with eigenvalue 
A t so that K t {u t ) = X t ■ u t . 

For t G {tj — 5, tj+5), we have an orthogonal decomposition of U into lA' t @U" where 
U" = spanj^t} and U' t is its orthogonal complement. Set a t = (u t ,v t ), v' t — v t — a t u t 
and K' t (w) = K(w) — X t (u t ,w)u t for w <EU. Note that K' t is invertible on IA[ and set 
w t = a t u t + Xt( y K' t )~ 1 v' t . The vector (w t , —At) spans ker L t for t G (tj — e, tj + e). Since 
the inner product ((w t , —Xt), (0, 1)) changes sign at tj, it follows that the orientation 
of IIjOr changes relative to O t at tj. Such a change occurs for each tj, which is where 
Sf(Ka,K t ) changes by ±1. 
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This proves the second claim in case ker K Zl is trivial. For the general case, we 
may assume that all the eigenvalues of K t which approach zero as t — > are neg- 
ative for t near 1. This implies that Sf(K Q ,Ki) = Sf(K ,K t ) for t G (1 — 6,1). 
We then claim that the orientation given by H^Lt (— i^~ 1 (f 2t ), l) propagates to 
(«i A . . . A u k A {-K- l (v Zl ), 1)) ® («! A . . . A w fe )*. 

Recall our convention for propagating the orientation of ind L across a point where 
the dim ker L jumps. The orientation given by HkerL t (~ K~^{v zi ), l) propagates to 

((-K-\v Zl ), 1) A u x A . . . A u k ) ® (Z t {ui) A ... A L t (it fc ) 

where L 4 = ilcokerLj ° L t . Since L t is negative definite on spanjwi, . . . ,u k }, it fol- 
lows that L t {ui) A ... A L t (u k ) is proportional to (— l) k U\ A . . . A u k . Permuting the 
(— K^-^v^), l) factor past all the Mj's introduces another (— l) fc which cancels with 
the first. □ 



Applying Proposition fn| to the oriented strata in a regular moduli space gives the 
following corollary. 

Corollary 4.5. Assume that p : [—1, 1] — > ^{^o) is a path of perturbations such that 
Ai p (+i), Aip(-i), and W p are all regular. Then —1 and +1 are regular values of the 
projections from W* and Wp to [—1,1]. Suppose e = ±1 and ([A],e) G M* p i E ) U-Mp( e )> 
and set s = Sf (Kq^, Ka, p ( e )) ■ Then the boundary orientation ofW* or W T p at i\A\,e) 
equals (— l) s if e = 1 and it equals — (— l) s if e = —1. 

Proof. Note that the boundary orientation at (L4],e) is positive if and only if the 
orientation on the 1-dimensional stratum of W p at ([A], e) agrees with eI1*Ok. In the 
irreducible case, K(A, p(e)) is an isomorphism, so the remark following Proposition 



4.4 proves the claim. 



The reducible case also follows by a direct application of Proposition \L% letting 

IvMA)| t=e 



-47r 2 4V ' p t {A)\ play the role of the v Zl for the operator L(A,p,t) and observing 



that this vector is orthogonal to ker K(A, p{s)) = H^(X; su(3)). □ 
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4.4. Orientations near a bifurcation point. In this subsection, we identify the 
boundary orientation of a bifurcation point with the oriented f) 1 - spectral flow of 



K(A, h) along Wl across this point. The precise relationship is given in Lemma fO) 



This is the crucial observation needed for Theorem [4.7| , which is used in section [5] to 
show that our invariant is well-defined. 

Consider the operator L(A,p,t) : Q 0+1 (X; su(3)) © R — > Q 0+1 {X; su(3)) for a 
fixed p G C 1 ([— 1, 1], JF(e )) such that W p , -M p (_i), and A^ p (+i) are regular. Suppose 
that W p has a bifurcation point, which we take to be ([A],0) for simplicity of nota- 
tion. Assume that A G As(u(2)xU(i)) is a representative of the orbit [A]. Choose a 
covariantly constant, diagonal sii(3)-valued 0-form 

( i/3 



G 7i^(X;su(3)). 



i/3 

y -2i/3 y 

Then the complex structure J on fi 0+1 (X;[)- L ) is given by exp(7ru/2) G Stab A 
acting by conjugation, i.e., Jx = [u,x] for x G f2 0+1 (X; f)- 1 ). Choose a nonzero 
x G 7-^ A) (X; f)- 1 ) and set y = Jx. 

Let f G fi^X; f)) © R, be an element of ker L(A, p, 0) such that 

(u A x Ay Av) (g) (u A x Ay)* (12) 

is the orientation for indL at (A, p, 0). In other words, v is an oriented tangent vector 
for W r p . 

Solutions to the equation ( p ^(A') = near (A, 0) in Xa x [—1, 1] take the form 
(A',t) = (A + sx + o(s 2 ) , o(s 2 )) , s > 0, up to the action of Stab A. For such a 
nearby solution, x projects nontrivially into the 1-dimensional kernel of L(A',p,t) 
(this follows from Lemma p.ll| ) and its image, thought of as a tangent vector to W*, 
points away from the endpoint. 

We shall now compare the orientation of indL at (A',p,t) with that given by x. 
To do so, we consider 

L'(Z,a,r) = §- s L{A + sx,p,0)^,a,r)\ s=0 , 
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where the map on the right is restricted to ker L(A, p, 0) and then projected onto 
coker L(A, p, 0). 

One can check that dim ker L' = 1, and so the orientation on ker L(A', p, t) points 
in the direction of ex, where e = ±1 is such that 

(ex A u A v A y) <g> (L'(u) A L'(v) A L\y))* (13) 

is the orientation for ind L at (A, p, 0). The following lemma is the key step in proving 



Theorem 47 because it identifies this e in terms of the fj spectral flow of K(A, h). 



Lemma 4.6. Suppose that x,y,u are chosen as above. Denote by L[ the composition 
of V with the projection onto Q 1 (X ; su(3)) . Then 

(i) L'{u) = —y and L'(y) = —u, and 

(ii) L[(v) = D v {*d A >, Pt {x))\(A>,t)=(Afl)- 

Remark. Recall from section 2 that *d A ,h — *d A — 4-7T 2 Hess h(A). The notation D v 
means the derivative as (A,t) is varied with tangent vector v. 

Proof. First we compute that 

L\u) = fL(A + S x,0)(n,0,0)l =n 



ds 

§- s d A+sx {u) 



s=0 



= [x,u] = —[u,x] = —Jx = —y. 

A similar computation yields L'(y) = —u, and these together prove (i). 

Claim (ii) follows by commuting mixed partials as follows. Let (a, r) denote the 
components of v in Q l (X; h) © R. 



L[(a,T) = £ s (*d A+sx (a)-4n 2 Ressp (A + sx)(a)-4n 2 T§- t Vp t (A + sx)\ t=0 ) 
- " 3 (*F(A + sx + ra) - 4iT 2 Vp rT (A + sx + ra))\, , 



s=0 



3s9r l' 2 1^''^ ' °" ' ' ™)) | (r jS )=(0 ) 0) 

= D M (& (*F(A' + sx) -^Pt(A' + sx))\ s J\ {A , it)={Afi) 
= D iajT) (*d AI)Pt {x))\ {Aljt)={A0) 
This completes the proof of (ii). □ 
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Using part (i) of Lemma |4~6| and comparing the two orientations for indL at ([A], 0) 
given in equations (^) and fll^D, we see that e has the opposite sign of the inner 
product (L'(v),x), where v is the oriented vector tangent to W p at ([A],0). From 
part (ii) of the lemma, it follows that (L'(v),x) has the same sign as the derivative 
of the path of (multiplicity two) eigenvalues of K(A + ra, p rT ) which crosses zero at 
r = 0. Figure 2 illustrates what this means in terms of spectral flow. Here W p is the 
dotted line and W* the solid one. In the diagram on the left, Sf f) ±(A_,A + ) = —2 
and in the one on the right, Sf t) ±(A_, A + ) = 2. 





A. 



A + 



A + 



Figure 2. A neighborhood of a bifurcation point in W p . 

Caution. The operator K(A,h) on fi 0+1 (X;f) ± ) is equivariant with respect to the 
action of Stab A = U(l), thus it is Hermitian with respect to J. Viewed this way, 
the eigenvalue here would have (complex) multiplicity one, but in order to avoid 
confusion, we regard K(A, h) on (0+l)-forms with values in either component of the 
splitting su(3) — f) © t) x as a real operator. 

Summing over all the bifurcation points results in the following theorem. 

Theorem 4.7. Let p £ C 1 ([— 1, 1], JF(eo)) be a curve with W p , M. p {±\) regular and 
suppose C is a connected component ofW p . Define b(C) to be the number of bifurca- 
tion points on C counted with orientation as boundary points of W* . 

(i) IfdC = 0, then b{C) = 0. 

(ii) IfdC = ([A + ],e + ) U — ([A_], e_), where e± £ {— 1,+1} are not necessarily dis- 
tinct, then b(C) = | Sf i) ±(A_,A + ), provided the representatives A± for [A±] are 
chosen to lie on the same component of a lift of C to A r . 

Proof. To prove (i), suppose C is a component of W p with dC = 0. Choose a path of 
connections A s and perturbations h s for s £ [0,1] such that ([A.],/i s ) parameterizes 
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C. Then A\ = gAo for some g G Q. Proposition |3.7] implies that the entire path A s 
of perturbed flat connections lies within eo of some component K of the space of flat 
connections upstairs in A. By our choice of eo, that proposition also shows that A s 
does not come within eo of any other component of the flat connections. But if A 
is within eo of K, then gA = A x is within eo of gK since we are using the standard 
gauge invariant L\ metric. Thus gK = K. 

Now CS : A — > K is constant on connected components of the space of flat 
connections, and this implies that g G Go, the connected component of the identity in 
G, since otherwise degg 7^ 0. Therefore, using the relationship between spectral flow 
and degree described in the remark following Proposition |Q| , we get 

b(C) = \Sf^{K AoM) K AlM ) = 2{CS{A 1 ) - CS(A )) = 0. 

This proves (i), and part (ii) of the theorem is clear. □ 

Example. We indicate briefly the consequence of the above theorem for the situation 
illustrated in Figure [I]. First of all, part (i) of Theorem [4 .7| implies that the f) -1 spectral 
flow around the one closed component equals 0. 

Along the other components, which are the two other dotted curves, the h -1 spectral 
flow in the oriented direction equals 2 for the component on top and it equals 4 for 
the one on bottom. In other words, the f) -1 spectral flow along the bottom component 
from left to right equals —4. 
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5. The Invariant 

In this section, we define the invariant \su(3){X) for X an orientable, integral 
homology 3-sphere. Choose an orientation and Riemannian metric on X, as well as 
a collection T = {71, . . . ,7„} of embedded solid tori in X satisfying the conlusion of 
Proposition |T4|. Let T(eo) be the eo neighborhood of in jF r , where eo is given by 
Proposition [3.7| . Then choose a perturbation h £ .^(eo) so that M. h is regular. By 
Proposition [3.9| , M* h is a compact 0- manifold. We would like to define an invariant of 
X by counting the points [A] £ Ai* h with sign according to the parity of the spectral 
flow of K. This integer, however, depends on the choice of perturbation h £ ^(eo) 
and in order to obtain a well-defined invariant, we must include a correction term 
determined from Ai r h . 

When the perturbation h is clear from the context, we let Sf(A , Ax) be an abbre- 
viation for Sf(KA_ (h h, KA ly h)- For A , A\ £ A r , the spectral flow splits as 

SfiA^AJ = Sf^AJ + Sf^A^A,) 

according to the decomposition su(3) = f) © f)- 1 . 

Theorem 5.1. Suppose that h £ with M.^ is regular. Pick gauge represen- 

tatives A for each orbit [A] £ A4h, md for each representative of a reducible orbit 
[A] £ M. r h , choose also a flat connection A with \\A — A\\ L 2 < eo- The quantity 

E (-V^-l E ^) SmA \Sf h ^A)-ACS{A)). 

[A]eM* h [A]eMi 

is independent of choice of representatives A for [A] in both sums and independent of 
the choice of h. 



Proof. Note that the existence of A is guaranteed by Proposition |3.7| . We first ar- 
gue that the quantity is independent of the representatives A chosen for the or- 
bits [A] £ M r h . Write X'(h) = T,[A]eMi(- 1 ) Sf(e ' A) for the &St SUm and = 
lE^e^-^^HSM^) - 4 CS(A)) for the second. Part (ii) of Proposition 
shows that \'(h) is independent of choice of the representatives A for [A] £ M* h . 
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Also, for a fixed representative A for [A] G Ai^, if A and A' are both flat connections 
in an eo neighborhood of A, then part (iv) of Proposition |3.7| implies that A and A' lie 
on the same component of the flat connections, hence CS(A) = CS(A'). Now suppose 
g G Q. Then, by the remark following Proposition |4.3| , Sf^±(A,gA) = Adegg. Since 
CS(gA) = CS(A) + degg, X"(h) is also independent of the choice of representatives 
A for [A] G M r h . 

We now argue that the above quantity is independent of choice of h. Suppose that 
h- and h + are admissible functions in T(eo) and that Aih± ar e both regular. Set 
.M± = A4h± and connect h- and h + by a path p : [—1, 1] — > ^{eo) with p(±l) = /i± 
so that the parameterized moduli space W p is regular. 

Compactify the irreducible stratum W* by adding bifurcation points and denote 
the compact, oriented 1-manifold with boundary so obtained by W*. Of course, the 
total number of boundary points, counted with boundary orientation, equals zero. 
Every boundary point which is not a bifurcation point can be identified with a point 
in the disjoint union M* U M.\. The orientations of these points are described by 
Corollary [15|, as follows. For [A] G M* + , the boundary orientation of W* at ([A], +1) 
is (— l) s fW> A \ while for [A] G M*_, the boundary orientation of ([A],— 1) at W* is 
— (— \} s ^ e,A \ Therefore \'(h+)— X'(h-) equals minus the number of bifurcation points 
counted with orientation as boundary points of W*. 

It remains to show that this algebraic sum of bifurcation points equals \"(h+) — 
A"(/i_). To prove this, we invoke Theorem [4.7| . By part (i), the closed components 
of Wp do not contribute to this sum, so suppose that C is a component of W T p and 
dC = ([A + ],e + ) U — ([A_], £_), where e± G { — 1, 1}. Let b(C) be the algebraic sum of 
bifurcation points on C. Since X"(h + ) and X"(h-) are both independent of the choice 
of representatives A for [A] , we can choose A + and A_ to lie on the same component 
of the lift of C to A r . Thus CS(Al) = CS(Al). By part (ii) of Theorem gjj, 

b(C) = ±Sf^(A-,A + ) = \ {Sf^(6,A + ) - Sf^{9,AJ)) . 
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On the other hand, the contribution to X"(h + ) — A"(/i_) from the endpoints of C is 

\ Sf^e, a + ) + M-i)tf(M-) sf^e, a.) 



It is important to keep in mind that e± need not be distinct; several possibilities 
are pictured in Figure 1. Now the reducible case of Corollary |4.5| implies that e + = 
(_]_)S/(M+) anc l £ _ = (_ i*)Sf(e,A-)^ an( j ^jj^g completes the proof. □ 



The quantity in Proposition 5.1 is seen to be independent of the choice of metric 



on X by the same argument as was used for Proposition 2.3 of [2~3|. That it is also 



independent of the choice of T is an exercise which we leave for the reader. 

Definition 5.2. Suppose that h 6 F(eo) o,nd that M.h is regular. Define the SU(3) 
Casson invariant by 



A 



su®(X)= £ Yl (-l) SmA \Sf f) 40,A)-4CS(A) + 2). 

[A]eM* h [A\£Ml 

By Theorem [371, this gives a well-defined invariant of integral homology 3-spheres. 



Notice that the last term in the second sum above simply adds a multiple of the 
SU(2) Casson invariant. This part of \su(3){X) is independent of h by the argument 
given in ||24|| . Therefore, the previous theorem implies that \su(3)(X) is independent 
of h G ^"(eo). The following proposition explains why we have chosen to normalize 
Ast/(3)P0 this way. 

Proposition 5.3. (i) If niX = 0, then \ S u(3)(X) = 0. 
(h) Xsu(3)(—X) = \ S u(3)(X). 

Proof. Part (i) is obvious. To prove (ii), observe that 

Sy_ x (A),Ai) = -Sf x (A ,A 1 ) - (dimkeri^ + dimker i^J, 

where the subscript indicates a choice of orientation on X. This is equally valid for 
f}- 1 coefficients in case Aq and A\ are reducible. Applying this to all three spectral 
flows appearing in the definition of Xsu(3)(~ X) and noting further that CS-x(A) = 
— CSx(A) complete the proof of part (ii). □ 
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6. Existence of Perturbation Curves 

This section is devoted to finding loops in X with certain properties required for 
our transversality arguments in Section 3. The basic question is whether the trace 
of holonomy can detect a tangent vector to the flat moduli space. In terms of a one- 
parameter family A t of irreducible flat SU(3) connections, we ask: does there exist 
an element 7 G fti(X) such that 

£trhol,(A t )\ t=0 ^0? 

The answer is no if A t = gtA , so we must also assume that A t is not tangent to 
the gauge orbit QAq. In fact, we need this for any path A t of connections such that 
A is flat and A t is flat to first order (i.e., ^-^A t | t _ = 0). An affirmative answer 
to this question for SU(2) and SU(3) is given in the first two subsections. The last 
subsection treats the reducible case, where second order arguments are required. 

6.1. First order arguments. To start, we introduce some notation. Given a flat 
connection A and a based loop £ : [0, 1] — ► X, let He(A) G SU(3) be the holonomy 
of A around £. For a G Q l (X, su(3)), let Ii(a, A) G su(3) be the integral 

Jo 

where Pe{0, t) is the parallel translation from to t along £ using the connection A. 
When A and a are clear from context, we write simply Hi and I p. 

If A t = A+ta+0(t 2 ), by Corollary g/| we see that j- t tr H e (A t )\ t=Q = tr(H e (A)It{a, A)). 

Proposition 6.1. Suppose A is a flat SU(3) connection. If a G 7i\(X; su(3)) is 
non-zero, then there is a loop I so that In projects non-trivially onto z(Hi), the Lie 
algebra of the centralizer Z(Hp). 

Proof. Consider the differential equation oIaC, = a. We can solve this equation locally 
on any 3-ball B C X since H\(B\ su(3)) = 0. Because a is not exact, there is no 
global solution. Thus there exists some loop £ : [0, 1] — > X (which can be taken 
to be embedded) for which the local solutions do not match up at the ends. Hence 
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a\i is not exact, meaning that its decomposition a\i = ah + dj& into harmonic and 
exact parts has ah 7^ 0. From this point on, we restrict our attention to the pullback 
connection t(A) on the SU(3) bundle over the circle S 1 = [0, l]/0 ~ 1 pulled back 
via the loop I. 

Note that is Hodge dual with respect to the metric on the loop to a covariantly 
constant 0-form, and so integrates to something nonzero in H^^^S 1 ; su(3)), the 
Lie algebra of Stab (£* (A)). By the fundamental theorem of calculus, the exact part 
integrates to H^b^Hi — bo, where b denotes the value of b at the basepoint. This 
latter su(3) element is orthogonal to TC^^^S 1 ; su(3)) (note that its left translation 
to TH e SU(3) is tangent to the adjoint orbit of Hi). □ 

The following 'warm-up' proposition treats the case SU{2). 

Proposition 6.2. If A is an irreducible flat SU(2) connection and a G 7i\(X\ su{2)) 
is nonzero, then there exists a curve 7 with ir(if 7 / 7 ) ^ 0. 



Proof. Since a is nonzero and harmonic, by Proposition |6.1| we can choose a curve 
so that Xl z ( H ^{Ig) 7^ 0. Gauge transform A so that 

A 

A- 1 



Ho 



is diagonal and write 

ia (3 
j3 —ia 

Then tr(H(l() = a(X — A) 7^ unless Hi = ±J. Taking 7 = I proves the claim if 
Hi ^ ±1. Otherwise, we can always find 7 so that tr(H 1 Ii) 7^ 0. Using the fact that 
Hi is central, it follows that 

tr(H T iI r i) = tr(H y H e I e ) + tr{H^H t ) 

= ±(tr(H y I t ) + tr(H^I 7 )). 

Since tr{H 1 Ii) is nonzero, it follows that either tr(H T £l T i) or tr(H 1 I~ l ) is also nonzero, 
and this proves the proposition. □ 
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The same is true for SU(3), but it takes more work to prove. 



Theorem 6.3. If A is an irreducible flat SU(3) connection and a 6 7i\(X\ su(3)) is 
nonzero, then there exists a curve 7 with tr(H^I^) 7^ 0. 

Proof. Choose £ so that H z (HA(Ie) 7^ 0. Gauge transform so that 



/ 



H, 



Ai 



\ 



is diagonal and write 



lOLl 



\ 



) 



* ZC(3 

where aj are real numbers, not all zero. Of course, A3 = (A^)" 1 and 0J3 = —ct\ — a 2 . 
If Hi has only one eigenvalue, namely if Ai = A2 = A3, then Hi is central and 



the theorem follows from the same argument as was used to prove Proposition B72 



Otherwise, either Hp has three distinct eigenvalues or it may be further conjugated 
so that Ai = A 2 7^ A 3 . The following argument treats only the first of these two cases. 
The second case requires a more elaborate argument, given in the next subsection. 

Assume Ai, A2 and A3 are all distinct. Suppose first of all that = for some i, 
which can be taken (wlog) to be i = 3. Since tr(Ip) = 0, 

tr(H e I e ) = Ai(zai) + A 2 (ia 2 ) = ia^Xi - A 2 ), 

which is nonzero since a% 7^ and Ai 7^ A 2 . 

Now suppose «j 7^ for all i. By replacing a with —a, if necessary, we can assume 
that two of the a^s are positive, which we take (wlog) to be a% and a 2 . Then 

tr(H e I e ) = zAicni + iA 2 ct 2 - -i(AiA 2 ) _1 (ai + a 2 ). 

Thus tr(Hele) = implies Ai«i + A 2 a 2 = (AiA 2 ) _1 («i + a 2 ). If this were the case, 
then |Ai«i + A 2 a 2 | = \a± + a 2 \, which is only possible if Ai = A 2 , a contradiction. 
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The following example illustrates the difficulties when Hi has only two distinct 
eigenvalues. Suppose 

( ^ n \ 



Then one see that triHpIi) = if 



A 
A 

A" 2 



V 



la * 

—ia 
* 



\ 



/ 



The next subsection is devoted to treating this problematic case. Observe that we 
can assume that Hi has infinite order for the following reason. If Hp has finite order 
k and if 7 is chosen so that tr(H^I £ k) 7^ 0, then just as in the proof of Proposition 



6.2, we compute that 



tr(H y .ihI T £k) = tr(H^I e k) + tr(H^I^j 



But tr(if 7 /£fc) 7^ 0, hence it follows that one of the other two terms is also non-zero. 



6.2. Linear algebra. In this subsection, we complete the proof of Theorem |6.3| 
demonstrating the existence of perturbation curves with certain properties. The 
remaining case is when Hi has only two distinct eigenvalues. As indicated in the 
previous subsection, we can further assume that Hp has infinite order. Although Hp 
may not have three distinct eigenvalues, the following proposition assures us that H 1 
has three distinct eigenvalues for some loop 7. 



Proposition 6.4. If q : ni(X) — > SU(3) is an irreducible representation, then there 
exists some element 7 6 ni(X) such that 0(7) has three distinct eigenvalues. 



Remark. Besides the existence of the irreducible, rank three representation, the proof 
makes no assumptions on the group 7ii(X). 
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Proof. By irreducibility, we can find £ with g(£) noncentral. Set L = g{£). Obviously, 
we are done unless L has only two distinct eigenvalues. Since the conclusion of the 
proposition is invariant under conjugation, we can assume 



/a o \ 



L 



A 

v A -2 J 

is diagonal. By irreducibility of g, there exists m e it\{X) so that g(m) does not 
commute with L. Set M = g(m). Thus neither M nor LM is diagonal. Of course, we 
can also assume that M has only two distinct eigenvalues; otherwise we are done! Let 
H be the eigenvalue of M of multiplicity two. Now both L and M have 2-dimensional 
eigenspaces, so for dimensional reasons, L and M have a common eigenvector. After 
conjugating by a matrix commuting with L, it follows that M can be written in block 
diagonal form: 

/ n 

M = 

y o a 

where 





and \a\ 2 + |6| 2 = 1. The matrix product LM also comes in block form: 

/ \u \ 

LM = where 5 = 

V B ) 

We claim that LM has three distinct eigenvalues. First of all, notice that the two 
eigenvalues of B are distinct; otherwise LM would be diagonal, in which case L and 
M would commute. So it suffices to prove that A/x is not an eigenvalue of B. 

Suppose to the contrary that A/i is an eigenvalue of B, i.e., suppose (A/i) 2 — 
tr(B)(Xii) + det(L>) = 0. Computing tr(B) directly, one finds 

tr{B) = |a| 2 (A/i + A"V 2 ) + (1 - \a\ 2 )(X^ 2 + A -2 //). 
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Plugging this into the characteristic equation and using det B = A // gives 

(1 - |a| 2 )(AV + A'V 1 - AV 1 - A~V 2 ) = 0. 

So either \a\ = 1, implying A = ±7 and contradicting our choice of M, or, after 
multiplying by A/i, 







A 3 // 3 + 1 - A 3 - ,u 3 = (A 3 - l)(/i 3 - 1). 



However, A 3 = 1 implies L is central and fi 3 = 1 implies M is central, each giving 
contradictions. Hence A/z is not an eigenvalue of B, which proves our claim. □ 



With regard to Theorem we have already proved the existence of 7 unless 
Hi(A) has two distinct eigenvalues, so assume 



H e (A) 



( 



\ 



A 
A 

A- 2 



\ 



/ 



Set L t = He(A t ) where A t = A + ta. Observe moreover that we are done unless 



dt 



U 



t=o 



\ 



ta 

— ia 




\ 



/ 



where a^O. 

Before stating the next lemma, we make a definition. 



Definition 6.5. For a fixed angle r\ G [0, 2n), let G v be the subset of 577(3) consisting 
of matrices of the form 



^ a be lv c ^ 



M 



be 171 a ce ir] 
d de~ ir > d 



J 



for a, b, c, d, d e C. Note that M e 51/(3) |c| = |c'|. 
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Clearly G v is a subgroup; in fact, matrices of this form in SL(3, C) form a subgroup 
of complex codimension 4, so one would expect that G v has real codimension 4 in 
577(3). This is indeed the case; if M is chosen as above and 



/ 1 



y/2 







\ 



then P E 17(3), 



P~ X MP 



y o V2 o j 



( a + b y/2c ^ 
V2c' d 
a-b 



and so G n is conjugate to the subgroup S(U(2) x U(l)). 



Lemma 6.6. Suppose that L t , M t : (— e, e) — ► SU(3) are smooth paths. Write L' 
Lq 1 ^jf\ t _ , and assume both L and L' are diagonal, with 



/a \ 



u = 



A 



V 



and L' Q = 



I 



\ 



A- 2 

for A a complex unit of infinite order and for a^O. If 



la 

— ia 




\ 



f t tr(W t )\ t=0 = 



for every word W t in L t and M t , then M G G v for some rj. 



Proof. For general L,M e SU(3) with 



L = 



/a, o\ 

A 2 

A 3 
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diagonal and M = (fJ,ij) arbitrary, it is not difficult to verify that 

3 

tr(LM) = J2 X ^ 
i=i 

3 

tr(LML- x M- v ) = J2 X ^Mj\ 2 - 

Now suppose L t , M t are as in the hypotheses. We write M t = (fJ>ij(t)) and let 
/lij = Hij(0) for convenience. Applying the above formula to L k M t and L k M t L^ k M^ 1 
and taking derivatives, we see from the hypotheses that 

= f t HL k t M t )\ t=0 

= A fe | (/in(t) + + A 2fc ^ss(*)U + <fcaA * ^ ~ ^ > 

and that 

= itr(L*M t L; k M-% =() 

= f t (i/in(t)i 2 + i^ 2 (t)i 2 + im*)i 2 + i^ 22 (t)i 2 + i/issWi 2 ) u 

+ A 3fe I (|^ 3 (t)| 2 + IMODL + A 3fc I (|/i 3 i(t)| 2 + IM*)| 2 )| t=0 
+ A;a {2(|/i 12 | 2 - |/i 21 | 2 ) + A 3fe (|/i 13 | 2 - |^ 23 | 2 ) - A 3fc (|/x 31 | 2 - |/i 32 | 2 )} ■ 

Since both equations hold for all k > and since A has infinite order, we deduce that: 

(i) /in =^22, (h) |^i 2 | = |/42i |, 

(iii) |^i3 1 = |/x 23 1 , (iv) |/i 3 i | = |/i 32 |. 

Here, (i) is a consequence of the first equation and (ii)-(iv) come from the second. 
The last three conditions are equivalent to the existence of angles 771,772, and 773 with 
A*2i = e* 2r Vi2, H23 = e im fj, 13 , and /t 32 = e~ %m ii zl . 

To conclude that M £ G,,, we just need to show that 771 = 772 = 773 mod (2n). 
Applying (i) to (M ) 2 implies /ti 3 /t 3 i = /i 23 /i32, thus 772 = 773 mod (27r). Now apply 
the unitary condition to M to see = Yl^=i ^ij^sj f° r * = 1? 2. Comparing these, we 
conclude 771 = 772 mod (2tt). This completes the proof of the lemma. □ 
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To establish Theorem |Q| , we seek a curve 7 such that tr(H^Ij) 0. Setting 
A t = A + ta, this is equivalent to the condition that ^ tr H^(A t ) | 7^ 0. According 
to the previous lemma, letting 7 range over all words in L and M , the only way this 
can fail is if Mo G G v for some r/. We shall show in the following argument that the 
irreducibility of A guarantees the existence of an M = H m (A) such that M G" G n for 
any rj. 

Proof of Theorem |6'. j| . We provide the proof in the remaining case when L = 
Hi(A) has two distinct eigenvalues and is of infinite order. Set A t = A + ta and 
L t = Hz(A t ). By Proposition |6.4| , we have a loop m\ such that H mi (A) has three 
distinct eigenvalues. Set M 1 = H mi (A) and M lt = H mi (A t ). Assume first that 
Mi $l G v for any rj G [0, 2-71"]. By Lemma |6.6| , there is a word W t in L t and M 14 such 



that f t tr W t 



i=0 



^ 0. Taking 7 as the loop obtained from the corresponding word in 



and mi, then W t = H 7 (A t ) and hence 4 tr Hj(At] 
in this case. 

So now suppose M x e G m and write 

/ 



lt=o 



Mi 



6ie ir?1 



bie~ 



-i>n 



Cl 



7^ 0, which proves the theorem 



\ 



:,'V1 



ai cie 
\ c'i c'ie~' iri1 di J 

Although A t has been gauge transformed so that the path Hi(A t ) is diagonal, we can 
further conjugate by a diagonal matrix since it acts trivially on Hi(A t ). Applying such 
a conjugation to Mi, we can arrange that 61 and ci are both real and non- negative. 

Since A is irreducible, we can choose m 2 G vri(A) such that M 2 = H m2 (A) G" G Vl . 
Repeating the argument above with Mi replaced by M 2 , we can assume that M 2 G G m 
for some 7/ 2 and write 



/ 



M 2 



a 2 b 2 e-^ 2 
b 2 e ir > 2 a 2 



\ 



\ 



c' 2 e- im al 2 



c 2 

c 2 e iV2 

■> ■ •■ u? 2 

We now claim that one of MxM 2 and Mf 1 M 2 is not contained in G v for any 77. 
This completes the proof of Theorem IOI by repeating once again the above argument 
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with Mi replaced by either MiM 2 or Mi 1 M 2 and invoking Lemma |6.6| to produce 
the curve 7 with the desired properties. 

So, it only remains to establish the claim, which is proved by contradiction. Suppose 
that M X M 2 is contained in G v for some rj. Equating the (1, 1) and (2, 2) entries of 
M 1 M 2 , we find 

bib 2 u 2 + c x c 2 u - (6i6 2 + cic' 2 ) = 0, (14) 

where u = e t( - m ~ rn K 

Suppose first of all that bi = 0. Because C\ = =>- Mi is diagonal, and u = 1 => 
M 2 e G Vl , neither of which is the case, the only possibility is that c' 2 = 0. But writing 
out M\M 2 and demanding that the off-diagonal terms have the required form, this 
would imply that b 2 — or u — 1, both of which lead to contradictions. 

So assume b\ 7^ 0. By similar considerations, we can also assume b 2 7^ 0. Solving 



equation (|14|) for u gives 



dc 2 

u = — 1 



6162' 

since we have already seen that the other possibility, namely u = 1, leads to a con- 
tradiction. 

The same reasoning applied to M^~ 1 M 2 shows that 

M = _i_S^. 

hb 2 

Equating these two formulas for u gives 

Cl bx = ci&i. 

Since b\ and c\ are real, this shows that c' x = C\ = c[, which forces both a\ and d\ to 
also be real. It immediately follows that Mf 1 = Ml = Mi, hence the eigenvalues of 
Mi equal ±1. In particular, Mi has at most two distinct eigenvalues, which contradicts 
our choice of Mi. This proves the claim and concludes the proof of Theorem |6.3| . □ 



Given loops £1, . . . ,£ n in X, define gauge invariant functions fj,gj : A — > K for 
j = l,... ,n to be the real and imaginary parts of tr holi^A), so that 

tr(hol l AA)) = f j {A)+igj(A). 
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Note that if A is an £77(2) connection, then gj(A) = 0. 



Corollary 6.7. (i) If A is an irreducible, flat SU(2) connection, then there exist 
loops £i, . . . ,£ n so that the map from Ti,\(X; su(2)) to R n given by 
a t— > (Dfi(A)(a), . . . , Df n (A)(a)) is injective. 
(ii) If A is an irreducible, flat SU(3) connection, then there exist loops £%,... ,£ n so 
that the map from 7i\(X\ su(3)) to IR 2n given by 
a ^ (Df l (A)(a), D gi (A)(a), . . . , Df n (A)(a), Dg n {A)(a)) is injective. 

6.3. Second order arguments. Suppose now that A is a reducible flat SU(3) con- 
nection on X. Then part (i) of Corollary |6.7| allows us to find loops about which the 
real part of the derivative of trace of holonomy detects any first order deformations of 
A in directions tangent to the reducible stratum, i.e., in the directions of 7i\(X; f)). 
But invariance under the gauge group, in particular under Stab(A) = U(l), prevents 
the derivative from detecting first order deformations in directions normal to the 
reducible stratum, i.e., in the directions of 7i\{X\ [) ± ). Instead, we consider second 
derivatives of the gauge invariant functions in these directions. This portion of the 
argument closely parallels the argument used to handle abelian flat connections in 
the SU(2) moduli space 0. 

Notice first that 7i\(X; f)- 1 ) is a module over the quaternions H. To see this, let 
SP(1) be the unit quaternions and define (p : SU{2) — > SP{1) by 



a —b 
b a 



a + Jb 



and F : C 2 -> H by F{v u v 2 ) = v x + Jv 2 . Then for A G SU{2) and v G C 2 , 

F(Av) = cf)(A)F(v). 

This turns the action of SU(2) on C 2 into left multiplication by elements of SP(1) 
on EL 

Now suppose g : tti(X) — > SU(2) is an irreducible representation and let E g be the 
flat bundle X x^ux) C 2 , where X is the universal cover of X and iti(X) acts by deck 
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transformations on X and via the canonical representation of ^on C 2 . We identify E Q 
as a fiat bundle with the subbundle of adP = X x su(3) corresponding to f)- 1 C su(3). 
The de Rham theorem provides an isomorphism TC\(X; ) = H l (X]E Q ). Here, 
H 1 {X;E e ) = Z X [X\ Eg)/ B 1 (X; E e ) is by definition the space of 1-cocycles modulo 
the 1-coboundaries. Using a presentation iri(X) = (xi, . . . ,x n | r 1; . . . , r m ), we 
can identify the 1-cochains as elements (pi, . . . ,v n ) G C 2 x • • • x C 2 = HP and the 
subspaces Z 1 (X;E e ) of 1-cocycles and B 1 (X;E g ) of 1-coboundaries as submodules. 
For example, (t>i, . . . ,v n ) is a coboundary if and only if there is some v G C 2 such 
that Vi = v — g(xi)v for i = 1, . . . , n. Observe that B 1 (X;E e ) is closed under right 
multiplication by elements in H. Similarly, (v\, . . . , v n ) is a cocycle if and only if the 
following linear equations, which are derived from the relations r±, . . . ,r m using the 
Fox differential calculus, are satisfied: 

M llVl + ■■■ + M ln v n = 

: (15) 
M ml vx H h M mn v n = 0. 

Here each is a sum of SU(2) matrices and thus is a 2 x 2 matrix of the form 



Ma 



for some Oy, G C. For v = (v i, v 2 ) G C 2 and h = Z\ + Jz 2 G H, where z%, z 2 G C, 
set v ■ h — (ziV\ — z 2 v 2 , z 2 v\ + z\v 2 ) G C 2 . (This is just multiplication in H under 
the isomorphism F : C 2 = H.) Now if (v\, . . . ,v n ) satisfies (fl5|) above, then so does 
(t>i ■ h, . . . , v n ■ h). This shows that Z l (X;E g ) is closed under right multiplication 
by elements of H. Since both B 1 (X;E g ) and Z 1 {X\E e ) are right H-modules, so is 
H\X-E e ) = Z\X-E e )/B\X-E e ). 

Recalling the notation of Definition 3^, we use HermH^(X; f)- 1 ) to denote the set 



of all symmetric Stab(A) = ^7(1) invariant bilinear forms on 7i\(X; f) -1 ), regarded as 
a real vector space with a U(l) action. 
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Proposition 6.8. If A is a reducible flat connection, then there exist loops £\, . . . , £ ni 
in X and a set F = {f±, . . . , /„} of gauge invariant functions such that: 

(i) Each fiEFis the real or imaginary part of tr hol^ for some j = 1, . . . ,n±. 

(ii) The map W l — ► Hermli,\(X ; f)- 1 ) given by (xi, . . . ,x n ) i— > Ym=i x * Hess fi(A) 
is surjective. 

(iii) Dfi(A)=Ofori = l,...,n. 

Proof. Assume A has been gauge transformed to take values in su(2) C su(3) and 
denote by A the associated irreducible SU(2) connection. In order to construct the 
loops £i, . . . ,£ ni , we will need to introduce curves in X that are in a certain sense 
dual to a basis for H\(X; f)- 1 ) over H. 

Let q : 7Ti(X) — > SU(2) be the irreducible SU(2) representation associated to 
A, and let E g = X x^x) C 2 as before. Consider Hi(X;E e ), homology with local 
coefficients in E e , which is by definition the homology of the complex 

Ci(X) ® z[)riW] C 2 Ci_i(X) (g)z [wi (x)] C 2 — • • • . 

From our previous discussion, it is not hard to see that H\(X; E e ) is a right H-module. 
Thus, we have a basis for H\(X; E e ) over H consisting of classes each of which can be 
represented by a C 2 -labelled curve 7$ in the universal cover X of X. Each 7$ is a lift 
of a loop 7, in X with /io/ 7i (A) = 1 (because the labelled lift of 7$ lies in ker #i <E> 1 
if and only if the holonomy of A around 7$ is trivial). Let . . . ,u m be the Horn 
dual basis for H l (X\ E e ) over HI. Of course, each uji determines a real, 4-dimensional 
subspace Vi = 0(span H Wi) C 7i\(X; f)^) where : H 1 {X]E e ) — > Ti\{X] f) -1 ) is the 
isomorphism provided by the de Rham theorem. Each is preserved by the subgroup 
Stab(A) C G, thus 

^(Ilf) 1 )^^®-'©^ (16) 

is a decomposition of H\(X; f)- 1 ) into 2-dimensional complex vector spaces. We denote 
by Oj the image of a G ?i\(X; t)- 1 ) under the projection pj : H\(X; h^) — > V^. 

Let U = Herm7i\(X; f)- 1 ) be the space of symmetric Stab(A) = U{\) invariant 
bilinear forms on H\(X; t)- 1 ). Our goal is to find a collection of loops such that the 
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Hessians of the real and imaginary parts of the trace of holonomy functions around 
these loops span U. 

There is a decomposition of U corresponding to dl6|) given by U = © i<3 - Uij, where 
B G Uij in case 

B(a,b) = < 

y B(ai, bj) + B(a,j, bi) iii^j. 

Thus every B G Uij is entirely determined by its restriction to Vi x Vj. Let {a, 6} be 
a basis for Vi and {c,d} a basis for Vj. In terms of the real bases {a,ia,b, ib} for Vi 
and {c,ic,d,id} for Vj, the restriction of B to Vi x Vj is a real 4x4 matrix of the 
form 

x y z 
x —z y 
y —z w 
z z w 

From this, it follows that 

(4 if % — j 
8 ifi^j. 

We prove the proposition by constructing, for each i < j, gauge invariant functions 
satisfying conditions (i) and (hi) such that their Hessians at A span Uij. We begin 
with the case %— j. 

Given (3 : [0, 1] — > X with /3(0) = parallel translation can be used to associate 
a function a : [0, 1] — > t) 1 - to any su (3)- valued 1-form a by setting 

ar(t)dt = Pp(0, t)~ l a m P^ t), (18) 

where Pp(0, t) is parallel translation by A along /3 from /3(0) to /3(t). If a G 7Y^(X; I) -1 ), 
then a{t)dt = J a G f) -1 . The linear transformation 7i^(X; f) -1 ) — > f} 1 - defined by 
an a has kernel Vi ffi • • - Vi ■ ■ ■ © V m (because the basis ui, . . . , uj m is Horn dual 
to 71, . . . ,7m) and determines an isomorphism Vi — > I} -1 . 



if i = j, and 



P 
-Q 
t 
u 



q 
v 

-u 
t 



r s 

—s r 

v w 

—w v 



if i ^ j. 



;i7) 
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Note how the correspondence fll8|) behaves for products of loops. If (3 — i\ ■ ■ ■ £k ■ 
[0, k] — > X (where each li : [i — 1, i] — > X is a loop), define aj : [i — — > f)- 1 by 
a t (t)dt = P £ .(i - l,t)- 1 a, iW P £i (2 - l,t). Defining a : [0, k] -> f) x by ©, then 

a(*) = /ioZ^ (A) -1 • • • hok^A^a^t) hol^A) ■ ■ ■ hol £l (A) (19) 

for t G [i — 1, i]. 

Lemma 6.9. Suppose £ is a loop with L := hole(A) G ST/ (3) nontrivial. If a,b G 
7i\(X; f)- 1 ) and «/ we se£ £j = J ael) 1 and ^ = J 6 G f) -1 , i/ien 

(i) Hess fr fco/ 7i (A)(a, 6) = 2 £r(&<;). 

(ii) Hess trhole^Ajfab) = tr{L{&Q + (&)). 

Proof Let B,B e : H\(X; f)- 1 ) x 7i^(X; f)- 1 ) — ► C be the symmetric, bilinear pairings 
coming from the Hessians at A of trhol li and tr hole. yi , respectively. (Notice that 
B(a,b) G M because ZtoZ 7i (A) is trivial. This follows from 2/7 (ii) and the elementary 
fact that tr{£t) G R for f , C G I) 1 .) 

Since S and are both symmetric, and since J (a + 6) = & + Q, it suffices to 
show (i) and (ii) in the case a = b. To prove (i), parameterize 7, by the interval [0, 1] 
and define a : [0, 1] — > f) -1 associated to the 1-form a G H\(X; f)- 1 ) using dl8|). Using 
the formula from Corollary |2]7] (ii) and noting that /joZ 7i (A) is trivial, it follows that 

Hess tr hol 7i (A) (a, a) — tr(a(s)a(t) + a(t)a(s))dtds 

Jo Jo 



1 rl 



tr(a(s)a(t))dtds 

1 \ 

2^ 



= tr yj a(s)ds J a(t)dt J = tr(£ 
This proves (i). 

To prove (ii), set /3 = £ ■ ji and parameterize it by the interval [0,2] so that the 
subintervals [0,1] and [1,2] parameterize £ and 7^, respectively. Define a : [0,2] — > 
C 2 associated to the 1-form a using fll8|). Notice that a(t)dt = because the 
restriction of any element of TC\(X; f)- 1 ) to a loop £ : S 1 — > X is exact whenever 
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holg(A) is nontrivial (since Tt^^JS 1 ] f) -1 ) = 0, which implies that Tlj^^JS 1 ] f) -1 ) = 
by Poincare duality). Hence by ([0J) we see that 

a(t)dt = / a(t)dt = L~%L. 



'0 Jl 

Appealing once again to Corollary ^/7| (ii), it follows that 



Hess tr holg. 7i (A)(a, a) — tr [L(a(s)a(t) + a(s)a(t))]dtds 

Jo Jo 



2 r 2 

tr [L a(s)a(t)) dsdt 



o Jo 



tr (J o La(s)ds a(t)dt) = tr(($L). 



□ 



Since aj = =>- f a — & = 0, it follows from (i) and (ii) above that the Hessians 
at A of the real and imaginary parts of tr hol li and tr holi. li lie in Uu. Consider the 
gauge invariant functions / = tr hol 7i and gi = 3m tr hol^. , where and 3m 
denote the real and imaginary parts. Note that / and gi obviously satisfy condition 
(i) of Proposition |6.8| . Moreover, since hol^(A) is trivial, Df(A) = 0. This follows 
from formula (i) of Corollary |2.7| . The same formula also implies that the imaginary 
part of D tr holt ni {A) vanishes since tr(L£) is real for ^ 6 i) 1 whenever the SU(3) 
matrix L is in the image of the standard inclusion SU(2) — > SU(3). This shows that 
Dgg(A) = 0, hence / and g% satisfy condition (iii) of Proposition |6l|. So, we only 
need to prove that we can span Uu with the Hessians of such functions. 

For this, we shall use the isomorphism Vi — > f)- 1 given by a i— » a, along with the 
standard identification (p : fp — > C 2 , to translate it into a question about symmetric, 
bilinear pairings C 2 x C 2 — > M. Denote by (-, •) the standard complex inner product 
on C 2 . If £, ( G f) -1 and v, w G C 2 are given by v = ip(£) and w = <p((), then 

tr{£t) = -2Ste(v,w). 

Moreover, if L = G ST7(2) and L = L © 1 G SC/(3), then 

ir(L(eC + C0) = ™> " (i(t"),«> -2Wz(v,w)- 
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In terms of the real basis {(g) , (q) > (i) , (i)} f° r ^ \ the symmetric bilinear form 
C 2 x C 2 -> C given by 



(v, w) i-> (L(v),w) + (L(w),v) + 29te(*;, w) 



has imaginary part represented by the matrix 



s 



-u 



t 







s -t 



u 



(L) = 2 



(20) 



— u —t —s 







t — u 



-s 



where a = r + is and (3 = t + iu. 

Now A is reducible (but not abelian) and thus we have x, y G tti{X) such that g(rr) 
and g(y) do not commute. We claim that the Hessians at A of the four functions 



derived from jj are linearly independent and form a basis for the 4-dimensional sub- 
space Ua <ZlA. 

To see this, restrict each Hessian to Vi x Vi and consider the associated symmetric 
4x4 matrix of the form (|i~7|). For example, the matrix associated to Hess f(A) 
equals —2 times the identity matrix. Clearly the image of SU{2) under \1/ in ( p0|) 
is the complementary subspace of dimension 3. Thus, it suffices to prove that the 
Hessians at A of g x ,g y and g xy , are linearly independent. One can see this by direct 
computation; arranging that g(x) is diagonal (by conjugation) and g(y) is not (by 
hypothesis), it becomes a routine exercise in linear algebra. 

This proves that the Hessians at A of /, g x , g y and g xy form a basis for Uu , and 
to conclude the proof of Proposition |6.8| , we need to find, for each i < j, functions 
satisfying (i) and (iii) whose Hessians span Ldj. 

Lemma 6.10. Suppose i < j and £ is a loop with hole{A) nontrivial. Set L = 
holg(A) G SU(3). Suppose further that a, b G H\(X; f)- 1 ), and set = f a G t)" 1 
and Ck = f b G f) 1 " for k = 1, . . . , m. Then 



igx-,gy, gxy 



59 



(i) Hess tr hol^(A)(a, b) = tr((& + + 0)) 

(ii) Hess tr hol lre -^.. e (A)(a, b) = tr({& + L^L' 1 )^ + LQL- 1 )). 

(iii) Hess tr fcofc.^ (A) (a, b) = tr(L(^ + &)(C< + Q) 

Proof. By symmetry, it is enough to prove (i)— (iii) in the case a = b. For (i), this is 
just the statement that 

Hess tr hol Jvlj (A)(a, a) = £r((& + £j) 2 ) 

for all a G 7i\(X; f)- 1 ), which follows directly from Corollary |2j] (ii) as in the proof 
of Lemma using the additional fact that J r r a — & + £j. 

To prove (ii), set (3 — 7, ■ £~ l • 7^ • £ and parameterize /3 by the interval [0, 4] so that 
the subintervals [0, 1], [1, 2], [2, 3] and [3, 4] parameterize 7,, t~ x , jj, and £, respectively. 
Define the function a : [0,4] — > f) -1 associated to the 1-form a using (0). 

Now a|[i,2] is exact since hole-i(A) is nontrivial. Similarly, a|[3,4] is exact. Thus 

pi j>3 

/ a(t)dt= \ a(t)dt + / a(t)dt = & + L^L' 1 
Jo Jo J2 

by (|TUD. Using Corollary again and noting that hoi /3(A) is trivial, it follows that 

/•4 ps 

Hess tr hol /3 (A) (a, a) =11 tr(a(s)a(t) + a(t)a(s))dtds 

-1\2\ 



./o 
4 M 



= tr a(s)a(t)dtds = tr((ii + L^U 

Jo Jo 

To prove part (iii), set f3 = i ■ 7^ ■ 7^ and parameterize (3 by the interval [0, 3] so that 
the subintervals [0, 1], [1,2] and [2,3] parameterize £, 7^ and jj, respectively. Define 
the function a : [0,3] — > f) 1 - associated to a using (]T~8|) . Use ([0|) and the fact that 
a I [0,1] is exact to conclude that 

J a{t)dt = J a{t)dt = L~ x (6 + QL. 
Now Corollary |2.7| implies that 



,3 ,3 

Hess tr hoi 13(A) (a, a) = / / tr[L a[s)a[t))dtds 

Jo Jo 



3 /-3 



tr [ J La(s)ds J a{t)dt ) = £r((& + £)> 
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and this completes the proof of (iii) . 



□ 



If a,i = = a,j, then £j = = £j and it follows from (i)-(iii) above that the Hessians 
at A of the real and imaginary parts of tr /ioZ 7i . 7i , tr holi-\. li .t. 1 ., and tr hol(.. li . lj lie in 
Uij. Consider the gauge invariant functions A — *■ R defined by / = £He hol 7i . T , fe = 
die tr holi-i.y-.^. and = 3m tr hol^^. . Then conditions (i) and (iii) of Proposition 
|678| are satisfied for /, fe and gg. Condition (i) obviously holds, and condition (iii) 
follows from Corollary |2.7| just as in the case % = j since the loops for / and ft 
(coming from parts (i) and (ii) of Lemma |6.10| ) have trivial holonomy and since ge is 
the imaginary part of trace of holonomy. 

So, to complete the proof of |6.8| , we just need to show that we can span Uij with 
the Hessians of such functions. Restricting elements in to Vi x Vj we obtain 4x4 
matrices as in (jl~7| ). In contrast to the previous case when % = j, these matrices are 
not generally symmetric. 

Suppose a e Vi and b G Vj. Then = and Q — 0. Let v = (p(£i) G C 2 and 
w = cp(Q e C 2 . UL = hole (A) G SU(2), (so L = L © 1), then Lemma gig implies 
that 

Hess/(A)(a,6) = tr(^Q) = -2ffc(v,w), 

Hess ft(A) (a, b) = trfeLQL- 1 ) = -2VKt(v , L(w)) , 

Hess g e (A)(a,b) = 3mtr(L^Q) = -Jm((L(v ), w) + (w, v)). 

Writing L = y^p^j where a = r + is and (3 = t + iu, then in terms of the real basis 
{(I) > (5) > (!) > (?)} for C2 > the bilinear pairing C 2 x C 2 -> C given by («,«;) i-> 
(f , L(w)) has real part represented by the matrix 

r — s t — u 
s r u t 

(21) 

—t —u r s 
u —t — s r 



$(L) = 



61 



Likewise, the bilinear pairing C 2 x C 2 -> C given by (v,w) i— > (L(v),w) + (w,v) has 
imaginary part represented by the matrix 

s 1 — r it i 
— Is —t u 

(22) 

it —t —s 1 — r 
t u r — 1 — s 

Notice that the images of SU(2) under $ and $ span complementary 4-dimensional 
subspaces of the 8-dimensional space of matrices of the form ( |T7| ) . 

Choose i,y £ fl^PO as before so that g(x) and g(y) do not commute. We first 
claim that the Hessians at A of f,f x ,f y and f xy are linearly independent. In fact, 
after restricting to Vi x Vj, they span the 4-dimensional subspace of matrices ([21]) . 
To show this, one only needs to show that the image of the set {/, g(x), g(y), g{xy)} 
under $ is linearly independent. Again, this follows from the hypotheses on g(x) and 
g(y) easily after assuming (by conjugation) that g(x) is diagonal. 

The complementary 4-dimensional subspace of Uij given by fl22|) can be spanned 
using functions gg. The image of the set {I , g(x) , g(y) , g(xy)} under \1/ is linearly 
dependent because ^f(I) = 0. However, a straightforward check shows that the image 
of {g{x) , g(x 2 ) , g(y) , g(xy)} under \l> is linearly independent. Hence, it follows that 
the Hessians of g x -,9x 2 -i9y an d g X y are linearly independent. Since their span is com- 
plementary to that of the Hessians at A of /, f x , f y and f xy , together they span 
and this completes the proof of Proposition |6.8| . □ 



9(L) = 
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